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Thl*  1*  Part  IV  of  a  aeries  of  report*  on  rational**  and 
technique*  of  matrix  factoring  which  play  an  important  rol* 
in  nultivariat*  analy*i*  technique*#  Indeed,  it  may  well  be 
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CHAPTER  1) 

THE  PROBLEM  OF  ORIGIN 
1J. I  Kindi  of  Origin  Problems 

In  th«  faotor  analysis  techniques  previously  discussed,  wt  have  axpraia- 
ly  or  loplioltly  aeeumed  that  va  bagln  with  althar  a  correlation  matrix  or  a 
matrix  of  atandardixad  measures.  In  tha  latter  caaa  the  meana  of  the  columns 
are  0  and  thalr  variances  unity. 

Wa  have  indicated  in  Chapter  4  that  tha  results  of  a  factor  analysis 
are  dependent  on  tha  selection  of  both  scale  and  origin  for  each  of  tha  vari¬ 
ables.  Wa  have  pointed  out  that  for  sane  variables,  such  as  height,  weight, 
time,  volume,  and  many  physiological  and  other  variables,  there  is  a  natural 
origin  which  means  that  when  the  value  of  the  variable  la  0,  none  of  that 
attribute  exists  for  a  particular  entity. 

We  have  also  indicated  that  in  psychology  and  many  other  disciplines  wa 
may  have  measures  In  which  it  is  difficult,  if  not  impossible,  to  specify  the 
true  zero  point  for  the  particular  attribute.  For  example,  in  psychological 
measures  the  score  is  frequently  tha  number  of  items  which  are  answered  cor¬ 
rectly.  If  the  items  are  very  difficult  and  are  administered  to  a  group  of 
first  grade  children,  perhaps  none  of  the  children  will  get  any  of  the  items 
correct.  If  these  items  are  supposed  to  measure  some  hind  of  Intelligence, 
we  certainly  may  not  assume  that  sane  of  the  children  have  no  intelligence 
because  they  got  none  of  the  items  correct. 

The  problem  of  determining  the  zero  points  for  a  particular  group  of 
measures  on  a  number  of  entitles  is  usually  solved  by  subtracting  the  mean 
from  each  variable,  so  that  the  resulting  measures  indicate  the  deviation 
of  each  of  the  Individuals  from  the  mean  of  the  group. 
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Wt  also  point ad  out  In  Chapter  4  that  tha  soaia  of  one  attributa  may  ba 
quita  different  from  that  of  another.  For  example,  a  difference  between  a 
■aora  of  5  and  a  ooora  of  10  on  a  toot  may  not  ba  comparable  to  tha  dlffaranoa 
batvaan  scores  of  9  and  10  on  anothar  test,  baoauaa  tha  ona  taat  may  hava 
many  mora  ltoma  in  It  than  tha  other,  and  tha  Itama  In  tha  former  may  ba 
much  mora  or  mueh  less  difficult* 

In  thla  ohapter,  however,  va  shall  not  eonaldar  tha  problam  of  aoallng 
tha  variables*  It  will  ba  racallad  that  usually  they  ara  sealed  ao  that  tha 
standard  deviations  ara  all  equal  to  unity.  Tha  mora  general  problem  of 
scaling  and  lta  affect  on  factor  analysis  will  be  considered  In  Chapter  19. 

In  this  chapter  va  shall  ba  concerned  with  problems  of  origin  as  they  relate 
to  factor  analysis  results. 

We  hava  In  general  three  kinds  of  origin  problems  for  a  data  matrix  of 
raw  measures.  Tha  first  of  these  ve  may  call  the  major  transformation  prob¬ 
lem,  the  second,  the  minor  transformation  problem,  and  the  third,  the  double 
transformation  problem. 

13.1.1  The  Major  Trans formation  Problem.  If  ve  have  a  vertical  data 
matrix  having  more  entities  than  attributes,  the  major  transformation  proce¬ 
dure  consists  of  premultiplying  the  raw  data  matrix  on  the  left  by  a  matrix 
whose  order  la  equal  to  the  major  dimension  of  the  vertical  matrix.  The 
typical  major  transformation  procedure  for  a  data  matrix  consists  simply  of 
subtracting  the  mean  of  each  column  vector  from  every  element  in  the  column. 

We  can  see,  however,  that  this  amounts  to  premultiplying  the  matrix  by 
a  special  kind  of  matrix,  as  indicated  in  Eq.  (13.1.1). 

(13.1.1) 


x  -  (I  -  -ijil  )  X 
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Here  vt  um  £  on  the  right  of  the  aquation  to  rapraaant  tha  raw  aoora  matrix* 
Tha  £  on  tha  la ft  rapraaanta  tha  daviation  aoora  matrix*  Tha  ordar  of  tha 
unit  vaator  la  N.  Tha  matrix  in  paranthaaaa  may  ba  colled  a  cantaring  matrix 
beoauaa  ita  pramultlplloation  into  tha  raw  aoora  matrix  raaulta  in  tha  £ 
matrix  whose  element#  are  centered  by  eolumna* 

Zt  la  easy  to  aaa  from  Eq*  (13*1*1)  that  if  ve  premultiply  both  aides 
of  this  aquation  by  tha  row  unit  vector,  ve  must  get  a  null  row  vaotor.  This 
la  because  premultiplication  of  tha  matrix  in  parentheses  by  tha  unit  vector 
yields  tha  null  veotor,  and  therefore  tha  left  hand  side  of  Eq.  (13*1*1) 
must  vonich. 

We  con  show  very  simply  that  this  matrix  operation  on  tha  rav  aoora 
matrix  is  the  same  as  if  we  had  subtracted  the  mean  of  each  column  of  the 
raw  score  matrix  from  each  element  of  the  corresponding  column*  We  indicate 
the  computation  of  the  vector  of  column  means  by  Eq.  (13*1.2). 

M*  ■  ■  ft  (l3*l*2) 

This  is  the  raw  score  matrix  premultiplied  by  a  row  unit  vector  and  divided 
by  the  number  of  rows.  This  is,  of  course,  the  conventional  definition  of 
a  vector  of  means. 

The  subtraction  of  the  mean  of  each  column  from  each  of  the  elements  in 
that  column  is  indicated  by  Eq*  (13.1*3)* 

x  *  X  •  1  M'  (13*1*3) 

It  can  readily  be  seen,  by  multiplying  out  the  x*ight  hand  side  of  Eq.  (13*1*1) 
and  using  Eq*  (13*1*2),  that  Eq*  (13*1*3)  results* 


Zt  my  not  always  be  true,  however,  that  wa  with  to  psrfona  our  analy- 
sia  upon  tha  deviation  score  matrix  indicated  in  Eq.  (13,1, >),  Instead  of 
aubtraoting  tha  maan  of  eaah  column  frem  tha  raw  acora  matrix,  ve  may  wish 
to  add  othar  eonatanta  to  tha  oolumna, 

This  case  la  lndioatad  by  Eq.  (13,1.4), 

u  -  x-iv'  (13.1.4) 

Hera  we  may  have  a  general  vootor  of  values,  V,  in  which  each  element  In  tha 
V  vootor  may  be  different.  Seme  of  tha  alemanta  may  be  poaltlve  and  acme 
negative.  If  we  have  a  aet  of  meaaurea  taken  from  arbitrary  origins,  and  If 
we  have  a  good  rationale  for  determining  what  the  natural  origins  ahould  be, 
ve  may  adjust  the  matrix  as  In  Eq.  (13.1.4)  so  that  the  attributes  of  the 
matrix  U  on  the  left  may  be  regarded  as  being  measured  from  the  natural  ori¬ 
gins  of  the  attributes. 

An  example  of  natural  origins  occurs  in  learning  data.  One  may,  for 
example,  have  a  group  of  subjects  who  are  learning  a  skill  such  as  typewrit¬ 
ing.  Measures  of  proficiency  for  a  group  of  subject  may  be  taken  at  weekly 
intervals,  A  speed  ecore  of  40  words  per  minute  during  the  third  week  would 
be  meaningful  when  compared  with  a  speed  score  of  60  the  fifth  week.  One  may 
therefore  construct  a  data  matrix  in  which  the  rows  are  entities  or  persons, 
and  the  columns  are  scores  made  at  successive  time  intervals.  To  take  devi¬ 
ation  neasuros  for  each  of  the  successive  time  intervals  rather  than  retain 
the  original  m.nwn’-n  may  Intw  pn»H p-ly  th*  information  that  one  is  inter¬ 
ested  in  studying. 

13.1.2  The  Minor  Transformation.  We  may  have  a  type  of  origin  problem 
leas  cannon  than  the  one  considered  in  the  previous  paragraphs.  This  may  be 
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oallsd  a  minor  transformation/  Hart  tha  data  matrix  la  multiplied  on  tha 
right  by  a  oantering  matrix  whoaa  ordar  ia  tha  minor  ordar  or  width  of  tha 
data  matrix*  Such  a  transformation  ia  indioatad  in  Eq.  (13,1,9), 

W  -  X  (I  -  )  (13.1.9) 

Hera  wo  have  tha  raw  score  matrix  X,  poatmultlplied  by  tha  centering  matrix 
in  parentheses*  This  operation  produces  tha  matrix  W  on  tha  laft  alda  of 
Eq.  (13.1.5)  vhoaa  rows  sum  up  to  O*  Zt  ia  easy  to  see  that  if  we  postaulti- 
ply  both  sides  of  Eq.  (13*1*5)  by  a  column  unit  vector,  the  result  must  be 
a  null  vector.  This  is  because  the  centering  matrix  poatmultlplied  by  the 
unit  vector  yields  a  null  vector. 

Let  us  now  see  what  this  type  of  operation  means.  We  indicate  a  column 
vector  of  row  means  by  Eq.  (13*1*6), 

Let 

m  -  (13*1*6) 

We  see  that  now  the  mean  of  each  row  is  subtracted  from  each  element 
in  the  corresponding  row  of  the  original  matrix,  as  in  Eq.  (13.1*7)* 

W  .  X-iil'  (13*1*7) 

If  we  multiply  out  the  right  hand  side  of  Eq.  (13.1.5)  and  substitute  from 
the  loft  of  Eq.  (13.1.6),  we  get  Eq,  (13.1*7). 

We  may  well  ask  why  one  should  wish  to  center  a  matrix  on  the  right 
in  this  fashion.  One  may  have  reason  to  believe  that  only  the  deviations 
of  scores  from  a  person's  own  mean  are  of  significance.  Certain  models  used 
in  the  measurement  of  personality  traits  result  in  right  centered  data  matri¬ 


ces. 
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Zt  may  be  that  Instead  of  subtracting  tha  msan  from  aaoh  row  of  a  data 
matrix,  wa  wiah  to  aubtraot  aona  othar  valua,  For  axampla,  wa  may  hava  a 
aarlaa  of  blood  praaaura  raadinga  ovar  a  parlod  of  tima  for  a  number  of  indl- 
viduala.  Zt  may  ba  thought  that  tha  aignifloant  tnoaaure  ia  not  tha  abaoluta 
blood  praaaura  at  any  intarval,  but  rathar  ita  davlation  from  tha  blood 
praaaura  during  a  given  condition  of  tha  individual,  auoh  aa  whan  ha  la  rest¬ 
ing  or  whan  ha  firat  got a  up  in  tha  morning. 

Xn  this  cnee  than,  a  different  valua  may  ba  aubtraatad  from  each  of  tha 
row  obsorvatlona  for  tha  Individuala,  as  lndlcatod  in  Eq,  (13,1.8). 

W  -  X  -  v  1'  (13.1.8) 


Hera  v  ia  a  vector  which  may  represent  acme  baae  state  for  each  of  the  indi¬ 
viduals,  and  ita  elements  may  vary  from  one  individual  to  the  next. 

Xn  ary  case,  the  results  of  the  factor  analysis  will  be  influenced  by 
the  right  centering  type  of  operation  or  the  generalization  of  it  indicated 
in  Eq.  (13.1.8). 

13.1*3  The  Double  Transformation.  Xn  the  previous  discussion  of  the 
minor  transformation  we  assumed  that  no  major  or  left  transformation  had 
been  performed  on  the  data  matrix.  Perhaps  the  more  common  case  involving 
the  minor  transformation  or  right  centering  of  the  data  matrix  occurs  when 
there  has  previously  been  a  major  or  left  centering  transformation  also.  It 
ia  perhaps  moat  common  to  center  a  data  matrix  on  the  right  after  it  has  been 
converted  to  a  deviation  score  matrix  whose  column  means  are  0. 

The  case  of  the  doubly  centered  matrix  ia  indicated  by  Eq.  (lj.1.9). 


s 


(I 


)  X  (I  - 


1  1' 


n 


(13.1.9) 
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Here  we  have  the  raw  score  matrix  pratnultiplied  by  a  cantaring  matrix  and  post- 
multiplied  by  another  cantaring  matrix.  It  must  ba  observed,  however,  that 
thaaa  ara  not  In  general  tha  lama  oentaring  raatricos,  since  tha  numbar  of  an- 
titlea  ia  not  uaually  tha  aama  aa  tha  manber  of  attributes.  Tha  numbar  of  en- 
titias  la  ordinarily  graatar  than  tho  numbar  of  attributaa.  Than  tha  ordar 
of  tha  left  centering  matrix  will  ba  larger  than  that  of  tha  right  centering 
matrix.  Thia  ia  indicated  by  tha  acolar  quantities  used  to  divide  tha  major 
product  mcment  of  tha  unit  vectors  in  the  porenthoaes.  It  will  ba  noticed 
that  on  tha  left  thia  la  N,  indicating  tha  numbar  of  cases,  and  on  the  right 
it  is  n,  indicating  the  numbar  of  variables. 

Let  us  now  define  a  matrix  or  scalar  quantity,  a,  aa  in  Eq.  (13.1.10). 

a  "  (13.1.10) 

This,  we  see,  is  obtained  by  taking  tha  sum  of  all  of  the  elements  in  the 
raw  score  matrix,  and  dividing  it  by  the  product  of  the  number  of  entitles 
by  the  number  of  attributaa,  and  then  taking  one  half  this  ratio.  Obviously 
then,  the  value  of  a  is  simply  one  half  the  average  valua  of  all  of  tha  ele¬ 
ments  in  the  data  matrix. 

We  next  define  a  row  vector  as  in  Eq.  (13.1.11). 

MV»  -  M'Bl'  (13.1.11) 

We  use  a  prescript  M  for  the  V  vector,  which  ia  simply  the  M  vector  of  Eq. 

( 13.1*2)  from  each  element  of  which  has  been  subtracted  the  scalar  a  given 
in  Eq.  (13.1.10). 

We  define  another  V  vector  with  a  prescript  m  as  in  Eq.  (13.1.12). 


m  -  a  1 


(13.1.12) 


ThU  1*  obtained  by  subtracting  from  each  fitment  of  the  vector  of  row  meane 
defined  in  Eq,  (13,1,6),  the  a  scalar  calculated  in  Eq,  (15,1,10), 

We  now  define  a  s  matrix  ae  in  Eq,  (15,1,15)* 

»  .  X-1MV'  *BV1'  (13.1.15) 

This  is  obtained  by  subtracting  from  the  raw  score  matrix  two  major  produote 
of  vectors,  The  first  of  these  Is  the  unit  vector  postaultlplied  by  the 
vector  calculated  in  Eq.  (15,1,11),  and  the  second  Is  the  vector  calculated 
In  Eq.  (15,1.12)  postmultlplied  by  the  unit  row  vector.  It  con  be  proved 
from  Eqs.  (15,1.9)  through  (13.1,12)  that  this  yields  a  matrix  which  is  both 
left  and  right  centered.  This  means  that  both  the  sums  of  rows  and  columns 
ere  0. 

It  should  be  observed  that  the  same  results  could  have  been  obtained  by 
first  performing  a  left  centering,  as  In  Eq.  (15,1.3),  and  then  performing  a 
right  centering  on  the  resulting  matrix,  as  in  Eq.  (13.1.7).  In  this  case, 
however,  the  right  centering  would  have  been  performed  on  the  x  matrix  cal¬ 
culated  in  Eq.  (13.1.3),  rather  than  on  the  raw  score  matrix  calculated  in 
Eq.  (13.1.7). 

As  in  the  previous  examples,  one  may  also  have  a  more  rational  basis 
for  adding  a  particular  scalar  to  each  element  in  a  column,  and  a  particular 
scalar  to  each  element  in  a  row.  This  model  is  indicated  in  Eq.  (13.1.1^). 

y  -  X  -  1  QV'  -  Qv  1*  (13.1.1^) 

Here  the  V  vector  and  the  v  vector  in  the  terms  on  the  right  side  of  the 
equation  consist  of  such  elements. 
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In  all  of  th*  three  cesee  indicated,  If  th#  constant*  added  produo*  right 
or  la  ft  oantarin*  or  both,  th*  analyst*  1*  somewhat  eimpler  than  if  general 
soalars  ar*  added,  as  in  Bqs,  (13,1,4),  (13,1,8),  and  (13,1, 14). 

13*2  Ipsativ*  M*a*ur*s 

W#  shall  next  consider  a  special  typ*  of  data  matrix  which  i*  a  *p*olal 
cas*  of  th*  minor  and  double  transformation  types  considered  above.  These 
are  sometimes  called  ipsative  measures. 

There  is  a  rather  large  class  of  problems  in  psychology  which  involves 
ipsative  measures.  These  measures  do  not  purport  to  be  comparable  from  one 
individual  to  another  for  a  given  attribute,  but  only  for  different  measures 
of  the  same  individual.  That  is,  the  measures  Indicate  the  relative  order 
of  magnitude  of  the  varia>  * '  for  a  particular  individual.  For  that  Individual 
the  origin  of  the  measures  may  be  quite  arbitrary.  Measures  such  as  these 
are  known  as  ipsative,  as  distinguished  from  normative  measures  which  do  indi* 
cate  for  a  particular  variable  the  differences  among  individuals.  This  gen¬ 
eral  problem  has  been  extensively  treated  by  Clemans  (1936)  in  a  doctor’s 
dissertation. 

First  we  shall  consider  how  in  psychology  we  may  obtain  matrices  of 
data  which  are  ipsative  or  which  merely  indicate  from  sane  arbitrary  origin 
for  each  person  his  value  on  each  of  the  variables  in  the  set. 

13*2.1  Definition  of  Ipsative  Variables.  We  begin  by  giving  a  more 
general  mat.hematl  oal  «t„f1n1t1on  of  ipsative  variables  than  is  commonly  used. 
We  have  seen  that  by  a  right  '>■'  t'KiuMon  in  which  the  row 

means  ait*  subtracted  from  each  element  in  a  row,  we  get  a  matrix  the  row 
sums  of  which  are  0.  We  could  now  arbitrarily  add  some  constant  or  scalar 
to  each  of  the  rows  of  this  resulting  matrix  so  that  the  rows  would  arid  up 
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to  a  constant  instead  of  adding  up  to  0» 

Naxt  lit  us  look  at  ths  probloM  in  »  diffsrsnt  way*  Suppose  that  we 
havft  »  matrix  of  raw  measures  obtained  in  some  particular  manner,  which  we 
chftU  discuss  in  wort  ihUU  later*  Suppose,  however,  that  this  matrix  ex¬ 
hibits  the  oharaatsriatio  that  the  sum  of  rova  all  add  up  to  the  same  con¬ 
stant,  say,  o,  as  indicated  in  Iq.  ( 15.2,1), 

XI  •  o  1  (13.2.1) 

This  equation  Indicates  that  ths  data  matrix  poatmultiplied  by  the  unit  vector 
is  equal  to  acme  constant  times  ths  unit  vector. 

Suppose  now  we  perform  a  left  centering  operation  on  this  matrix,  which 
amounts  to  putting  it  in  deviation  form  by  columns  so  that  the  sums  of  all 
columns  are  0.  This  operation  is  indicated  in  Eq.  (13.2.2). 

x  ■  (I  -  ■  •  )  X  (13*2.2) 

Recall  that  this  operation  simply  subtracts  the  mean  of  each  column  frca 
each  element  in  that  column. 

We  now  prove  that  the  resulting  matrix  x  has  the  properties  of  a  right 
centered  matrix,  ae  indicated  in  Eq.  (13.2.3). 

X  1  -  0  (13.2.3) 

This  means  that  the  sums  of  rows  of  the  resulting  matrix  are  all  0. 

The  proof  la  as  follows,  J'rom  Rq.  (13.2.2)  we  can  write  Eq.  (l3.2.b). 

x  1  -  X  1  -  *  ^  * -1)-  (13.2.4) 


Here  we  simply  expand  the  right  side  of  Eq.  (13.2,2), 


n 


Decauoe  of  Eq,  (13.2.1),  wo  can  writ*  Eq,  (13.2*3). 

V  X  1  -  c  1'  1  -  o  If  (13.2.3) 

This  moan*  that  the  sum  of  the  elements  In  the  X  matrix  1«  tha  constant  o 
time*  tho  number  of  entitles,  N. 

If  we  substitute  Eqs.  (13.2.1)  and  (13.2.3)  In  Eq.  (13*2.4),  v*  got  Eq. 

(13.2.6). 

xl  «  cl-cl  -  0  (13.2.6) 

This  proves  that  the  sums  of  rows  are  0  for  the  matrix  in  Eq.  (13*2.2). 

To  state  the  case  simply,  if  we  have  a  matrix  whose  row  elements  add 
up  to  the  same  constant  and  we  perform  a  left  centering  operation  on  this 
matrix,  the  resulting  matrix  is  such  that  its  row  elements  also  add  up  to  0. 
While  many  of  the  matrices  we  deal  with  in  psychology  are  not  directly  of 
tho  right  centered  type  whose  rows  add  up  to  0,  nevertheless,  when  they  are 
left  centered  or  put  in  deviation  form,  the  rows  are  also  in  deviation  form 
or  have  the  property  of  right  centered  matrices. 

13.2.2  Sources  of  Ipsative  Variables.  We  shall  now  consider  a  number 
of  different  ways  in  which  ipsative  matrices  can  arise.  We  shall  use  the 
term  ipsative  to  cover  any  set  of  measures  with  entity  rows  and  column  attri 
butes  such  that  the  row  sums  add  up  to  the  constant,  whether  this  constant 
la  0  or  different  from  0. 

One  type  of  model  which  involves  the  ipsative  matrix  is  the  differen¬ 
tial  prediction  model.  In  thi3  model  we  attempt  to  predict  in  which  of  a 
number  of  activity  variables  a  person  would  be  most  likely  to  be  superior. 
The  question,  however,  is  not  what  his  score  or  performance  would  be  in  each 
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of  the  criterion  varisblas  u  a  cm  pa rad  with  othar  parson*  In  the  sample, 
but  how  good  ht  would  ba  in  aaoh  criterion  measure  relative  to  hi a  perform- 
•no*  in  eaoh  of  th*  othar  criteria. 

It  can  ba  ahown  In  method*  devalopad  by  Korat  (1951*)  that  a  aolution 
of  such  a  problow  raaulta  from  tha  following  oparationa.  W*  raquira  • 
matrix  of  intaroorralationa  of  pradiotor  with  criterion  variablaa*  Itola 
may  or  may  not  ba  a  matrix  on  which  tha  eorralationa  for  all  paira  of  vari¬ 
able*  era  based  on  all  tha  eaaaa*  Usually  it  will  not  be,  as  wa  have  saan 
in  Chapter  11*  In  any  oasa,  suppose  wa  have  auoh  a  correlation  matrix  in 
which  tha  rows  are  correlations  of  a  given  pradiotor  variable  with  all  tha 
criterion  variables,  or  in  which  a  column  ia  the  correlation  of  a  given  cri¬ 
terion  variable  with  all  the  predictor  variables*  If  we  take  such  a  matrix 
and  perform  a  right  centering  operation  upon  it,  we  then  have  a  resulting 
matrix  whose  rows  add  up  to  0.  By  mean*  of  methods  which  ara  beyond  the 
scope  of  this  text,  we  then  use  this  right  cantered  matrix  together  with 
other  data  to  derive  a  matrix  of  prediction  weights  to  apply  to  the  pre¬ 
dictor  variables,  so  as  to  give  the  best  differential  prediction  of  success 
in  the  criterion  variables* 

Another  source  of  lpsative  measures  comes  frets  what  is  known  os  the 
forced  choice  type  of  psychological  inventory.  Here  the  subject  is  pre¬ 
sented  with  pairs  or  groups  of  items.  He  is  instructed  to  indicate  which 
of  these  is  most  like  him,  which  he  most  agrees  with,  or  some  other  instruc¬ 
tion,  which  requires  him  to  mark  only  one  of  each  pair  or  group.  If  these 
scales  are  properly  constructed,  they  have  the  advantage  that  the  subject 
is  choosing  among  the  two  or  more  items  on  the  basis  of  two  or  more  differ¬ 
ent  traits,  rather  than  on  the  basis  of  seme  single  dimension,  such  as  social 


desirability*  Examples  of  such  inventoriee  ore  the  Edwards  Pereonal  Prefer¬ 
ence  Rohedule,  the  Kuder  Preference  Record,  and  others* 

One  of  the  oharaateristias  of  these  measures  ie  that  normally  the  items 
are  paired  or  grouped  in  such  a  fashion  that  the  total  of  eaah  person’s  score 
on  each  scale  is  a  constant*  That  is,  if  the  inventory  is  scores,  say,  for 
1$  different  traits  or  measures,  the  sum  of  each  person's  measures  will  add 
up  to  the  same  constant.  Ifcia  means,  then,  that  if  a  set  of  measures  is 
transformed  to  deviation  measures  by  a  left  centering  operation,  the  sum 
of  rows  of  the  resulting  matrix  will  be  0. 

Another  source  of  lpsatized  measures  may  occur  when  it  is  desired  to 
detannine  experimentally  the  properties  of  ipsatlve,  as  distinguished  from 
normative,  measures.  Wright  (1957)  administered  the  Edwards  Personal  Prefer¬ 
ence  Schedule  to  a  group  of  individuals.  The  items  in  the  schedule  were  al¬ 
so  prepared  in  a  rating  scale  format  so  that  each  item  was  presented  singly, 
and  tho  same  subjects  were  requested  to  respond  on  a  rating  scale  which  in¬ 
dicated  the  extent  to  which  the  item  applied  to  them.  It  was  then  possible 
to  get  a  score  for  each  of  the  traits  presumably  measured  by  the  scale,  by 
means  of  an  appropriate  scoring  key*  Tho  problem  was  to  see  how  the  results 
of  this  kind  of  format  compared  with  those  of  the  forced  choice,  after  the 
rating  scale  measures  had  been  lpsatized  by  moans  of  a  right  centering  oper¬ 
ation. 

Another  type  of  ipsatization  seems  to  occur,  in  part,  with  self-apprais- 
al  inventories  of  the  Interest,  personality,  and  temperament  type,  even 
though  the  items  are  not  in  paired  or  forced  choice  format.  There  Is  evi¬ 
dence  to  indicate  that,  if  a  person  is  presented  with  a  set  of  items  or 
statements  in  which  he  is  asked  to  indicate  how  well  each  statement  applies 


to  him,  ho  sngsgss  In  n  sort  of  Mlf-ipsatixlng  operation.  In  othsr  words, 
hs  tends  to  Adopt  scow  sort  of  an  s vs  rags  of  all  of  tho  Items  as  tbsy  apply 
to  him,  and  thsn  indicate  which  of  tha  Items  Is  above  and  vhtoh  below  his 
own  average  for  all  of  the  items  in  the  set.  There  seems  to  be  a  tendency 
to  adjust  oneself  to  the  particular  set  in  a  relative  rather  than  an  absolute 
sense.  This  appears  to  be  a  special  ease  of  a  general  phenomenon  in  vhloh  it 
is  easier  to  make  cooperative  Judgments  rather  than  absolute  Judgments, 

Zn  any  case,  factor  analysis  of  items  of  this  kind  seems  to  give  results 
which  indioate  that  a  sort  of  partial  lpsatization  has  been  taking  place, 
even  though  not  a  complete  right  centering  type  of  operation. 

13.2.?  Characteristics  of  Xpsative  Matrices.  The  effect  of  either 
right  or  left  centering  of  a  matrix  on  the  rank  of  this  matrix  is  of  con¬ 
siderable  importance.  It  is  especially  so  when  lpaattve  measures  ere  used 
as  predictor  variables.  If,  aa  is  usually  the  case,  there  are  more  entities 
than  attributes,  then  tbs  lpsative  matrix,  after  left  centering  or  conversion 
to  deviation  form,  is  reduced  to  a  rank  one  less  than  its  width. 

This  can  be  seen  from  Eq.  (13.1.5)*  We  learned  in  Chapter  3  that  the 
product  of  any  two  matrices  cannot  be  greater  than  the  rank  of  the  factor  of 
smaller  rank.  If  the  matrix  in  Eq.  (13.1.3)  is  vertical,  the  right  center¬ 
ing  matrix  in  parentheses  will  be  of  the  same  order  aa  the  width  of  the  data 
matrix.  Its  rank,  however,  will  be  one  less  than  its  order;  otherwise,  it 
would  not  be  orthognnn!  *0  the  unit,  vector.  It  can  also  be  proved  that  it  ia 
of  rank  only  one  less  by  showing  that  it.  cannot  lie  orthogonal  to  any  other 
than  the  unit  vector, 

Aa  already  indicated,  ip3ative  measures,  whether  derived  frcm  experi¬ 
mental  or  from  computational  procedures,  cannot  be  normative  in  the  sense 
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that  on*  person  o«n  b*  cemparsd  with  another  with  rsspeot  to  a  single  vari¬ 
able,  This  la,  of  aoura*,  because  acme  arbitrary  oonatant  baa  b**n  added  or 
subtracted  from  all  aooroa  of  *aoh  aubjaot  measured,  Ulna*  thla  la  not  in 
general  th*  some  oonatant  for  all  aubjaot*,  th*  resulting  maaauraa  art  not 
comparable  from  on*  aubjaot  to  anothar.  Thla  limitation  of  lpaatlv*  maaauraa 
is  often  overlooked.  Frequently,  peraona  are  erroneously  compared  with  on* 
another  with  reapeot  to  ipaatlv*  maaauraa. 

13*3  Basic  Structure  and  tha  -Problem  of  Origin 

We  have  lndiaated  in  Section  1J.1  of  thla  chapter  that  in  general  th* 
fteotor  analytic  reaulta  will  vary  for  a  given  data  matrix  according  to  what 
is  done  about  th*  problem  of  origin.  The  importance  of  this  fact  ia  not  as 
widely  recognized  as  it  should  be.  We  shall  therefore  examine  the  effect  of 
row  and  column  origin  transformations  on  the  basic  structure  characteristic* 
of  the  data  matrix. 

In  what  follows,  we  shall  not  be  concerned  with  whether  the  scale  units 
are  the  same  for  each  of  the  variables  in  the  set.  We  shall  assume  for  the 
time  being  that  sane  sort  of  rational  or  natural  scaling  is  available,  or 
that  the  variables  have  been  scaled  in  terms  of  standard  deviation  or  equal 
variance  units.  The  problem  of  scale  will  be  considered  in  more  detail  in 
Chapter  15,  even  though  the  influence  of  scaling  on  basic  structure  is  cur¬ 
rently  not  well  understood. 

In  the  following  sections  we  shall  consider  four  cases.  The  first  of 
these  assumes  that  we  have  a  left  centered  matrix  in  equal  standard  deviation 
units,  and  that  we  have  already  available  the  basic  structure  solution  for 
the  corresponding  correlation  or  normative  covariance  matrix.  On  the  basis 
of  this  solution  we  wish  to  determine  the  basic  structure  of  the  raw  covari¬ 
ance  matrix,  i.e.,  the  covariance  matrix  of  the  data  matrix  prior  to  loft 
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centering, 

The  second  oase  assumes  that  we  have  the  basis  structure  factors  of  the 
oovariance  matrix  prior  to  left  centering,  and  we  wish  to  find  the  basic 
structure  matrices  of  the  correlation  matrix  as  functions  of  the  basio  struo 
ture  factors  of  the  raw  covariance  matrix. 

The  third  case  assumes  that  the  deviation  or  normative  data  matrix  has 
also  been  centered  on  the  right.  We  shall  investigate  the  basic  structure 
of  the  minor  product  moment  ipsative  covariance  matrix  of  this  lpsative  data 
matrix,  as  a  function  of  the  basio  structure  factors  of  the  correlation  or 
normative  covariance  matrix. 

In  the  fourth  case  we  have  the  basic  structure  of  the  covariance  matrix 
obtained  from  the  ipsative  data  matrix,  and  from  this  we  wish  to  calculate 
the  baaic  structure  of  the  correlation  or  normative  covariance  matrix. 

We  shall  now  consider  some  relationships  among  the  four  types  of  covari¬ 
ance  matrices. 

13.4  Basic  Structure  of  Raw  Covariance  Matrix  frcm  Correlation  Matrix 

13.4.1  Computational  Equations 

13.4.1a  Definition  of  Notation 

X  ia  the  raw  score  matrix. 

x  1s  the  deviation  score  matrix. 

M|  1b  the  vector  of  moans. 

C  is  the  normative  covariance  matrix. 


0  ia  the  raw  covariance  matrix 
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£  is  ths  baa  la  orthonormal  of  0, 
H  Is  ths  basis  orthonormal  of  0. 
&  is  ths  basis  diagonal  of  C, 

£  is  ths  basis  diagonal  of  0. 


13*4. lb  Ths  Equations 


X  ■ 

(l-ijji'jX 

(13.4.1) 

X  ■ 

PdQ' 

(13.4.2) 

M'  . 

1'  X 

•nr 

(13.4.3) 

C  - 

x#  x  -  <i  8  Q* 

(13.4.4) 

a  > 

X'l  >  RM' 

(13.4.5) 

v  . 

Q'  M 

(13.4.6) 

If  L  -  1 

1YL 
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'  81 
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If  L  >  1 

iyl 

*  ®L-1 

(13.4.9) 
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M|  a|  -p<° 

-  A 

If  kPL<0 

k+lyL  "  A 
k+lYL  "  kYL 

If  kPL>0 

k+lYL  "  kZL 


k+lyL  "  kyL 


f.l  "  •  *i  V 

H  -  Q  (f  DjJf) 

aQ  -  U  {j^ 


(13.4.11) 

(13.4.12) 

(13.4.13) 

(13.4.14) 

(13.4.15) 

(13.4.16) 

(13.4.17) 

(13.4.10) 

(13.4.19) 

(13.4.20) 


13.4.2  Computational  Instructions.  Wa  begin  with  a  Bcore  matrix  X, 
and  for  the  sake  of  simplicity  we  assume  that  the  measures  all  have  unit 
standard  deviations.  We  then  apply  a  left  centering  matrix  as  in  Eq.  (13.4.1). 
This,  as  we  know,  simply  subtracts  the  mean  of  each  of  the  measures  frco  every 
element  in  that  vector. 
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Next  wo  India ate  tho  basis  structure  of  this  standard  aoort  matrix  x, 
as  In  Eq.  (lj i <4, 2).  The  right  hand  aid*  is  tho  produot,  from  loft  to  right, 
of  the  loft  orthonormal  by  tho  basis  diagonal  by  tho  right  orthonormal* 

Tho  moans  of  tho  columns  of  tiro  X  matrix  aro  Indicated  in  Eq*  (13*4.3)* 
This  is  simply  a  row  vector  of  tho  means  of  the  variables* 

Tho  covariance  minor  product  moment  of  tho  matrix  in  Eq*  (13*4*2)  is 
given  by  Eq*  (13*4. I*),  Obviously,  tho  left  basic  orthonormal  disappears  and 
tho  diagonal  B  is  the  square  of  A  in  Eq*  (13*4.2). 

Eq.  (13.4.3)  is  not  a  computational  equation,  but  is  given  to  indicate 
the  minor  produot  moment  of  X  in  toxins  of  its  basic  structure.  The  basla 
orthonormalo  are  H  and  Hr,  respectively,  and  the  basic  diagonal  is  js.  We 
assume  that  the  £  and  the  8  matrices  in  Eq.  (13*4.4)  have  been  calculated 
according  to  one  of  the  basic  structure  methods  of  factor  analysis  indicated 
in  previous  chapters.  Tho  problem  now  is  to  find  the  basic  structure  factors 
of  tho  0  matrix  as  a  function  of  the  known  basic  structure  factors. 

First,  we  calculate  the  V  veotor  as  in  Eq.  (13*4.6).  Tills  vector  is  the 
transpose  of  the  §  matrix  calculated  in  Eq.  (13.4.4),  postmultipliod  tjr  the 
vector  of  means  calculated  in  Eq.  (13.4.3). 

To  solve  for  the  ^  elements  of  £  we  proceed  n3  follows. 

If  L  *  1  wo  calculate  a  scalar  ^  as  the  sum  of  the  minor  product 
moment  Of  V  in  Eq,  (13.4,6)  and  the  first  element  of  8,  viz,,  6^,  as  shown 
in  Eq,  (13.4.7). 

Wo  then  set  a  scalar  ^y^  equal  to  B^  as  indicated  in  Eq.  (13.4.0). 

If  L  is  greater  than  1  to  oet  ^  equal  to  B^,  as  in  Eq.  (13.4. 9)>  and 
wo  set  aqual  to  6^,  as  shown  iti  Eq.  (13.4.10). 


In  any  case,  as  shown  In  Eq,  (13,4,11),  w*  sat  a  scalar  ^  equal  to 
the  average  of  ^  and  where  the  latter  two  are  determined  iteratively, 
as  wo  shall  show  shortly,  for  k  going  from  1  to  acme  prespeolfied  Iteration 
limit. 

We  substitute  Z^  in  Eq,  (13.4,12), 

If  is  sufficiently  close  to  zero,  ae  indicated  by  seme  tolerance 
limit  P,  wo  take  ^  n»  the  value  of  as  shown  in  Eq.  (13,4,13). 

If  is  negative,  we  set  a  now  £  equal  to  and  the  new  Y  will  be 

the  same  as  the  previous  one,  as  shown  in  Eqs.  (13,4,1k)  and  (13.4.13). 

If  la  positive,  we  set  the  new  Y  equal  to  the  current  Z  and  the 
new  £  ia  the  some  ns  the  previous  one,  ns  shown  in  Eqs,  (13,4.16)  and  (13.4,17) 

Once  all  of  the  £'o  huvo  been  solved  for,  we  solve  for  vectors  which  are 
proportional  to  the  vectors  of  H  given  in  Eq,  (13.4.3)  by  means  of  Eq.(l3.4.l8) 
Tills  gives  the  solution  for  the  ith  column  of  an  f  matrix.  As  will  be  seen 
on  the  right  of  this  equation,  the  V  vector  defined  by  Eq.  (13.4.6)  is  pre¬ 
multiplied  by  the  inverac  of  a  diagonal  matrix.  This  diagonal  matrix  for 
the  ith  column  of  the  f  matrix  is  obtained  by  subtracting  from  the  5  matrix 
of  Eq,  (13.4.4)  the  already  solved  for. 

The  f  vector  solved  for  in  Ev,,  (13.4,18)  is  then  normalized,  as  indi¬ 
cated  by  the  product  in  parentheses  on  the  right  of  Eq,  (13.4,19).  In  addi¬ 
tion,  the  normalized  f  matrix  must  also  be  premultiplied  by  the  ^  matrix 
solved  for  in  Eq,  (13,4.4)  to  yield  the  H  matrix  of  Eq.  (13.4.19), 

To  get.  the  principal  axis  factor  loading  matrix  for  the  0  matrix  in  Eq, 
(13.4.5),  the  H  matrix  calculated  in  Eq,  (13.4.19)  must  be  postmultiplied  by 
the  square  root  of  the  diagonal  matrix  of  £  values.  This  is  indicated  in  Eq. 


13.4,3  Numerical  Example 

In  thlo  example  w»  shall  use  tho  some  correlation  matrix  as  in  previous 
ohaptoru,  The  vector  of  moans  used  to  generate  tho  raw  oovarianoo  matrix  to 
givon  in  Table  13,4,1, 

l/o  uhall  present  tho  throo  oovarianoo  matrices  -  raw,  normative,  and 
tpoativo,  us  veil  as  their  ‘basic  structures,  Tho  lpeatUing  vector  in  tho 
last  two  examples  was  taken  as  tho  unit  vector  divided  by  /  n  ", 

Table  13,4,2  gives  the  raw  oovarianoo  matrix  0  which  was  obtained  by 
adding  tho  major  product  moment  of  the  vector  in  Tablo  13.4,1  to  tho  correla- 
tlon  matrix. 

Tho  first  row  of  Table  13,4,3  gives  the  bnsla  diagonal  elements,  g,  of 
the  raw  covarlunce  matrix.  The  body  of  the  tuble  givos  the  basic  orthonormal 
K  of  the  raw  covariance  matrix  in  Table  13,4,2,  These  were  calculated  from 
0  by  a  method  in  Chapter  9,  as  were  also  Tables  13,4,5  and  13.4.7. 

Tabla  13.4.4  repoats  for  convenient  reference  tho  correlation  matrix  R. 

The  first  row  of  Table  13*4.5  gives  the  basic  diagonal  elements  ft  of  tho 
correlation  matrix  R.  The  body  of  the  table  gives  the  basic  orthonormal 
matrix  Q  of  R. 

Table  13.4.6  gives  the  ipoative  covariance  matrix  calculated  from  tho 
correlation  matrix  by  the  aquation  p  -  (i  -  )  R  (i  -  ). 

The  first  row  of  Table  13.4.7  gives  the  basic  diagonal  elements  of  the 
ipsative  correlation  matrix  p.  Thw  body  of  the  table  gives  the  basic  ortho- 
no  nnal  matrix  £  of  £. 

The  first  row  of  Table  13.4.8  gives  the  basic  diagonal  elements,  £,  of 
the  raw  covariance  matrix  ns  calculated  by  Eqs,  (13.4.7)  through  (13.4.17). 


Tho  body  of  the  table  give.  tho  basic  orthanormal  If  no  calculated  fern 

Bfl".  (ljS.4.X8)  and  { 13.4,19).  Note  that  thlo  matrix  to  the  transpose  of 

the  one  in  Table  1J.4.J.  3h*  value*  in  the  two  table,  agree  within  limitu 
of  dooiMal  no curauy. 
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Table  •  Ths  Victor  ot  Means  of  the  Pat*  Matrix 

•0,4  *0,3  >0,2  *0,1  *0,0  0,1  0,2  0,3  0,4 


Tabia  13,4,2  •  The  Raw  Covarlanoa  Matrix  <£ 

1.16000  0,94900  0.84000  0.14000  0,03300  0.06000  0.21000  0.18900  0.19100 

0.94900  1,09000  0.03500  0,14500  0,06100  0,09500  0.26300  0,23700  0.24900 

O.840OO  O.835OO  1.04000  0.29200  0.20500  0,21000  0.25600  0.21100  0,30500 

0.14000  0.14500  0.29200  1.01000  0.63600  0.61600  0.22900  0.15300  0.32900 

0.03300  0.06100  0.20500  0.63600  i. 00000  0.70900  0.13000  0.09100  0.25400 

0.06000  0.09500  0.21800  0.61600  0.70900  1.01000  0.21000  0.13300  0.33100 

0.21000  0.26300  0.25600  0.22900  0.13000  0,21000  1.04000  0.71400  0.60/00 

0.18900  O.257OO  0.21100  0.15300  0.09100  0.13300  0.71400  1.09000  0.66100 

0.19100  0.24900  0.30500  0.32900  0.25400  0.33100  0.60700  0.66100  1.16000 


Table  13.4.3  •  basic  Diagonals  a,  and  Baalo  Orthonoraal  H  of  ths  Raw  Covarianc# 
Matrix  “ 

3.75072  2.1C721  1.72066  0.50400  0.40746  0.34773  0.28544  0.22741  0.16937 

0.37762  0.45666  0.17015  0.04074  0.00506  0.00004  0.11851  -0.45801  -0.62802 

0.30013  0.41650  0.12300  0.02755  0.1C607  0.06037  0.05831  *0.24569  0.7624 6 

0.40369  0.29841  0.19922  -0.08977  -0.03400  -0.04380  -0.21507  0.79846  -0.11536 

0.28681  -0.34966  0.29652  0.09157  -0.80422  O.I0769  0.10423  -0.04775  0.06773 

0.23709  -0.41259  0.35441  0.10045  0.29603  0.24950  -0.66799  -0.20104  -0.03115 

0.26485  -0.40862  0.30373  0.02755  0.48419  -0.24399  0.60225  0.11329  -0.01920 

0.32623  -0.12108  -0.44122  0.49806  -O.O6532  -0.61914  -0.21504  -0.04648  0.01204 

0.31173  -0.10407  -0.52983  0.26521  0.11557  0.68133  0.20372  0.13054  -0.06949 

0.36221  -0.20973  -0.36750  -0.80740  -0.03244  -0.11623  -0.07552  -0.13262  -0.00460 


Tablet  13.4,4  -  The  Kcnsatlve  Covurianca  or  Correlation  Matrix  R 

1.00000  0.00900  0.76000  0.10800  0.03300  0.10800  0.29800  0.30900  0.35100 

0.82900  1.00000  0.77500  0.11500  0.06100  0.12500  0.32300  0.34700  0.36900 

0.76000  0.77500  1.00000  0.27200  0.20500  0.23800  0.29600  o.zrioo  0.38500 

0.10000  0.11500  0.27200  l.OCCOO  O.636OO  0.62600  0.24900  0.18300  0.36900 

0.03300  0.06100  0.20500  0.63600  1.00000  0.70900  0.13000  0.09100  0.25400 

0.10000  0.12500  0.23800  0.62600  0.70900  i.eoooo  0.19000  0.10300  0.29100 

0.29000  0.32300  0.29600  0.24900  0.13800  0.19000  1.00000  0.65400  0.52700 

0.30900  0.34700  O.27ICO  0.10300  0.09100  0.10300  O.65UOO  1.00000  0.54100 

0.35100  0.36900  O.305CO  0.36900  0.25400  0.29100  0.52700  0.54100  1.00000 


Table  13.4.5  -  Basic  Diagonals  8,  and  Basic  Orthonormal  Q  of  the  Correlation  Matrix 
3.74907  2.04953  1.33079  0.47442  0.36261  0.34740  0,20533  0.21215  0.16070 

0.37009  0.34414  -0.30364  O.C4349  0.01542  0.00399  -0.12630  -0.44249  -0.66221 
0.30211  0.33393  -0.27870  0.08123  0.07647  -0.05713  -O.o6o60  -0.31066  0.7408s 
0.39915  0,20657  -0.35222  -0.01294  -0.14020  0.02245  0.23294  0.77005  -0.07157 
0.28690  -0,45323  -0.0585'  -“.1  W-o  -‘M010-*  -0.15550  -0.17400  -0.13710  0.04754 
0,23932  -O.51976  -0.15671  0.16644  0,29930  -0.22904  0.66174  -0.19627  -0.04304 
0.26733  -0.40451  -0.16335  0.18600  0.40810  0.26440  -0.60582  0.16939  -O.OOI76 
O.33O0L  0,05539  0.50930  0.41016  -0.18573  0.60692  0.21552  -O.O6236  0.00760 
0.31760  0,11592  0.53843  0.23092  0.11339  -0.67780  -0.20136  0.15045  -0.05702 
0.36926  -0.0.1350  0.31947  -0.82141  0.24394  0.14790  0.06259  -0.03072  0,00389 
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Tab la  13,4,6  -  The  Ipsatlvo  Covarianae  Matrix  £ 

0,56370  0,37913  O.20059  -0,29896  -0,32607  -O.20O3O  -0,12196  -0,09141  -0,11474 

0,37915  0.5345?  0,20004  .0,30732  -0,31363  -0,27003  -0,11252  -0,06096  -0.11230 

0.20059  0,20004  0,47546  -0,10007  -0,19919  -0,19541  -0,16907  -0,17452  -0,12505 

-0,29096  -0,30752  -O.10OO7  0,62037  0.304 26  0,26504  -O.14363  -0,19007  -0,06941 

-0.32607  *0,31363  -0,19919  0,30426  0,71615  0,39593  -0,20674  -0,23419  -0,13652 

-O.20O3O  -O.27005  -0,19541  0,26504  0,39593  0,65770  -0,10396  -0, 25141  -0,12674 

-0.12196  -0.11232  -0,16907  -0,14363  -0,20674  -0,18396  0.59437  0,26793  0.07539 

-0.09141  -O.06O96  -0,17452  -0,19007  -0.23419  -0,25141  0.26793  0,63348  0.10915 

-0.11474  -0.11230  -0,12565  .0,06941  -0,13652  -0.12874  O.07559  0.10915  0.50201 

Table  13*4,7  -  Basis  Diagonals  d,  and  Basis  Orthonormal  of  the  Ipsative  Covariance 
Matrix  £, 

2.00395  1.33135  0,40297  0,30347  0,34929  0.20534  0.21507  0,16904  -0.00000 

-0.39220  0.30627  -0.04279  -0.01569  0.00150  -0.12549  0.44069  -0.64965  0.33334 

-O.30541  0.28213  -0.07309  -O.O7203  -0,04?48  -0,06l0l  0.20349  0.75083  0.33331' 

-0.26670  0.35823  0.04678  0.15209  O.035OI  0.23107  -0.77588  -0.08622  0.33334 

0.40533  O.C6788  O.104O5  0.77628-0.18170-0.17375  O.13256  0.05212  0.33333 
0.40304  0.16394  -0.16644  -0.29888  -0.20C60  0.66065  0.17497  -0.03241  0.33334 

0.44111  0.17168  -0.16513  -0.38-436  0.29794  -0.606G0  -0.18,124  -0.00140  0.33334 

-0.09835  -0.50431  -0.37720  0.22433  0.61O27  0.21600  0.05703  O.01119  0.33333 

-0.15311  -0.53508  -0.24311  -0.12428  -O.65532  -0.20398  -0.17536  -0.05301  0.33328 

-0.03365  -0.31090  0.83691  -0.25666  0.13948  0.06331  0.03572  0.00862  0.33333 


Table  13.4.8  -  Panic  Diagonal  Elements  0,  and  Basic  Orthonormnl  H*  as  Dots nni nod 
from  Basic  Structure  of  if 

3.75072  2.IO720  1.72065  0.50401  0.40746  0.34773  0.28544  0.22742  0.16938 


0.3776 

0.3082 

0.4037 

0.2068 

0.2300 

0.2648 

0.3262 

0.3117 

0.3622 

0.4566 

0.4165 

0.2984 

-0.34-97 

-0.4127 

-0.4006 

-0.1211 

-0.1041 

-0.2097 

0.1701 

0,1230 

0.1992 

O.2965 

0.3544 

0.3037 

-0.4412 

-O.5290 

-0.3675 

0.o4o8 

0.0276 

-0.0897 

0.0915 

0,1005 

0.0275 

0.4980 

0.2652 

-0.8074 

-0.0050 

-0.1061 

0.0348 

0.8042 

-0.2960 

-0.4842 

0.0653 

-0.1156 

0.0325 

0.0003 

0.0604 

-0.0438 

0.1077 

0.2495 

-0.2440 

-0.6192 

0.6813 

-0.1162 

-0.1105 

-0.0584 

0.2151 

-0.1843 

0.6679 

-0.6023 

0.2150 

-0.2037 

0.0755 

0.4530 

0.2457 

-0.7904 

0.0477 

0.2011 

-0.1133 

0.0465 

-O.I306 

0.1326 

0.6281 

-0.7624 

0.1153 

-0.0677 

0.0312 

0.0192 

-0.0129 

O.O695 

0.0046 

13.?  Tha  Normative  Covariance  Paolo  fltruoture  from  the  Haw  Covarianae  Paiio 
Utruature 

13,3,1  Computational  Citations 
I3,3,la  Definition  of  notation 
The  notation  Is  the  name  an  in  the  previous  section, 

13,5,1b  The  Equations 


V  -  H'  M 

(13*5.1) 

In  yn 

(13.5.2) 

lyn  ‘  0 

(13*5.3) 

1YL  "  \ 

(13.5* *0 

lyL  * 

(13.5.5) 

kYL  +  kyL 
k T,  2 

(13.5.6) 

n  V* 

p  -  X  - - i-j - 1 

k  1  1-1  01  k^L 

(13.5.7) 

tf  L  -  II  (0  -  6l  l)'1  V 

(13.5.8) 

W  r 

Q  -  - - — : - 

’  /*!l  W.L 

(13.5.9) 

13*5,2  Computational  Inutruotiona 

Flout  we  calculuto  tha  vootor  V  of  Eq.  (l3.5*l)»  This  la  the  vector  of 
ineanu  preimltiplted  by  the  r.l^ht  or  Uionounal  i>!  Uw»  raw  eovt>.rJ  mice  matrix*  0. 

Eqs.  (13,5.2)  and  (13*5*3)  give  tho  limits  of  the  normative  basic  diufjon 
al,  &  «  Equ,  (13*5*^)  and  (13.5*5)  give  tho  limits  of  the  normative  basic 
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diagonals  for  8^  where  Lis  leaa  than  n, 

Eq,  (13,5,6)  give#  tho  kth  approximation  to  the  Lth  basia  diagonal,  6^, 
To  solve  for  th«  Lth  .  baala  diagonal  of  jB^,  wo  uao  Eq,  (13,5,7)  itor- 
atlvely,  no  vo  uood  Eq,  (13,4,12)  to  solve  for  d^.  Wo  note,  however,  that 
tho  last  tom  on  tho  right  in  Eq,  (13,4,12)  is  +1,  vhoreas  it  is  -1  for  Eq, 
(13.5.7). 

Having  solved  for  tho  B' 0,  wo  substitute  those  in  Eq.  (13,5*8)  to  solve 
for  a  vector  proportional  to  tho  Lth  vector  of  Q,  the  basic  orthonormal  of 
the  correlation  or  normative  covariance  matrix. 

Eq.  (13.5*9)  shows  the  normalization  of  tho  W  _  vector  of  Eq.  (13.5.8) 
to  give  tho  Lth  vector  of  Q. 

13.5.3  numerical  Example 

Tho  first  row  of  Table  13. 5.1  gives  the  basic  diagonal  elements  B  of 
the  correlation  matrix  R  as  calculated  by  Eqs,  (13.5.I)  through  (13.5*7). 

The  body  of  the  table  gives  the  basic  orthonomal  Q*  of  R  as  calculated  by 
Eqs.  (13. 5. 0)  and  (13.5.9).  Rote  that  this  matrix  la  the  transpose  of  tho 
one  In  Table  13,4,5,  The  values  In  the  two  tables  agree  within  limits  of 
decimal  accuracy. 

13.6  The  Ipsat.lve  Ccvurlanoe  Panic  Structure  from  the  Normative  Covariance 
Paste  Structure 

13.6.1  Computational  Equations 
1J. 6. la  Definition  of  Notation 

R  is  the  normative  covariauce  matrix. 

9  is  the  basic  orthonormal  of  R. 


2T 


ft  la  the  basic  diagonal  of  R. 

£  i»  the  ipsative  covariance  matrix* 

£  ie  the  basic  orthonermal  of  £, 
d  is  the  baslo  diagonal  of  £t. 

V  is  a  normal  vector  whose  order  is  the  same  os  R, 

The  relation  between  £  and  R  is  given  by  p  ■  (I  -  V  V')  R  (l  -  V  V'), 
15.6. lb  The  Equations 


u  . 

Q'  V 

(15.6.1) 

w  - 

ft*  tf 

(13.6.2) 

l*n 

"  5n 

(15.6.3) 

lyn 

-  0 

(13.6. b) 

1*1 

•  *L 

(13.6.5) 

lyL 

-  8tf  1 

(13.6.6) 

kZL 

kTL  +  kyL 

“  2 

(13.6.7) 

kFL 

n  vf 

•  l  w-.-  z - 1 

1-1  *i  kZL 

(13.6.8) 

q.L 

-  Q  (ft  -  dL  I)'1  U  8 

(13.6.9) 
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Tobla  13,5.1  •  Baalu  Diagonal*  ft,  and  Baalo  Orthonomal  £'  a*  Detarmtnad  frnt  0 


3.74907  2.0495a  1.33077 

•O.370I  -0.3821  -0.3991 
-0,3442  -0.5539  -0,2066 
-0.3037  -0.2787  -0.3522 
-0.0435  -0.0812  0,0129 
0.0154  0.0765  -0,1403 
0.0039  -0,0571  0,0224 
0.1263  0,0606  -0.2329 
-0.4425  -0,3106  0.7709 
-0.6622  0.7409  -0,0715 


0.47442  0.38262  0,34740 

-0.2869  -0.2392  -0,2674 
0.4532  0.5197  0.4846 
-0.0586  -0,1567  -0.1633 
0.1486  -0,1664  -0.1868 
-0.7818  0.2993  0.4081 
•0.1555  -0.2291  0.2644 
0.1739  -0.6618  0.6058 
-0.1371  -0.1962  0.1693 
0.0476  -0.0431  -0.0017 


0.28533  0.21215  0.16871 

-0,3308  -0.3178  -0.3693 
-0.0556  -0.1159  0.0233 
0.5093  0,5384  0.3195 
-0.4182  -0.238?  0.8214 
-0.1358  0.1134  0,2440 
O.6069  -0,6778  0.1479 
-0.2156  0.2013  -0.0626 
-0.0623  0.1504  -0.03 07 
0.0075  -0.0570  O.OO89 
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13*6,2  Computational  Instructions 

Eq,  (13,6,1)  defines  a  vsotor  U  which  la  tha  product  of  tha  right  ortho- 
normal  matrix  of  R  poataultipllad  by  tha  ipsatising  vector  V, 

Eq,  (13,6,2)  daflnos  a  vaotor  W  which  is  tha  product  of  tha  tf  vaotor  In 
Eq.  (13,6,1)  pramultipllad  by  tha  square  root  of  tha  basic  diagonal  of  R, 

Eqs,  (13.6.3)  through  (13,6.6)  give  tha  first  approximations  to  tha 
limits  of  tha  basic  diagonals  of  £,  tha  lpsatized  covariance  matrix. 

Eq,  (13,6.7)  gives  tha  kth  approximation  to  tha  Lth  basic  diagonal  of 

£' 

The  iteration  procedure  for  getting  successively  smaller  bounds  for  the 
d's  is  the  same  as  In  the  two  previous  methods,  except  that  now  Eq.  (13.6,8) 
is  tho  iteration  equation.  It  is  of  the  same  form  as  in  the  previous  two 
methods.  In  this  case  the  "1"  is  subtracted  on  the  right  as  in  Eq.  (13.3.7). 

Eq.  (13.6,9)  gives  the  calculations  for  the  q  .  vectors  of  the  basic 
orthonormal  £  of  £.  The  factor  g  on  the  extreme  right  is  a  normalising 
scalar. 

13.6.3  Numerical  Example 

The  first  row  of  Table  13.6,1  gives  the  basic  diagonal  elements  d  of 
the  lpsatlve  matrix  £  as  calculated  from  Eqs.  (13.6.1)  through  (13.6.8).  The 
body  of  the  table  gives  the  basic  orthonormal  g'  of  £  as  calculated  freo  Eq. 
(I3.b.9).  Note  that  this  matrix  is  the  transpose  of  the  one  in  Table  13.^.7. 
The  values  in  both  tables  agree  within  limits  of  decimal  accuracy,  except 
the  last  line  of  Table  13.6.1.  This  discrepancy  is  due  ho  the  error  in  the 
loot  basin  diagonal,  vhivh  should  he  O  instead  of  .00002. 
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Tabl*  13.6,1  -Paolo  Diagonal#  d,  and  Baoio  Orthonerraal  gf  aa  Datermlnad 
Paalo  Dtruotura  of  R 


2.08393 

1.33155 

0.48296 

0.30347 

0,34928 

0.28534 

0.21506 

0.16903 

0.3923 

0,3054 

0.2667 

-0,4053 

-0.4830 

-0.4411 

0.0983 

0,1531 

0.3062 

0,2821 

0.3583 

0.0679 

0.1640 

0.1717 

-0,5043 

-0.5351 

-0,0428 

-0,0731 

0.0468 

0.1841 

-0.1664 

•0.1651 

-0.3772 

•0.2431 

-0.0157 

■0.0/28 

0.1521 

0.7763 

-0.2988 

-0,3844 

0.2243 

-0.1243 

0.0015 

-0.0475 

0.0359 

-O.lOl? 

-0.2085 

0.2979 

0.6183 

-0.6553 

0.1255 

0.0611 

-0.2310 

0.1738 

•O.6606 

0.6069 

-0.2160 

0.2041 

-0.4487 

-0,2035 

0.7758 

-0,1325 

-0.1750 

0.1813 

-0.0570 

0.1754 

-0.6496 

0.7508 

*0.0862 

O.0521 

-0.0324 

•0.0015 

0.0112 

-0.0530 

0.5171 

0.2582 

-0.0732 

0.2448 

0.5206 

0.2746 

0.2746 

0.4190 

from 


0.00002 

0.0336 

-0.3109 

0.8369 

-0.2567 

0.1395 

-O.O633 

-0.0357 

0.0006 

0.0571 
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13*7  The  Normative  Covariance  Baale  Structure  from  the  Ipuatlve  Pasta 
Structure 

13 • 7.1  Computational  Equations 
13.7.1a  Definition  of  Notation 
The  notation  la  tha  some  as  In  Qootion  13.6.1, 

13.7,1b  The  Equations 


u  ■ 

n  v 

(13.7.1) 

w  - 

q'  U 

(13.7.2) 

a  m, 

V'  u 

(13.7.3) 

1Y1 

+  n 

(13.7.4) 

lyl 

"  dl 

(13.7.5) 

iyl 

"  dL-l 

(13.7.6) 

iyL 

dL 

(13.7.7) 

kZL 

kYL  +  kyL 

*  2 

(13.7.0) 

kFL 

n-1  W* 

-  2  - =z —  +  .  z.  -  a 

L-l  dL  '  kZL  k  L 

(13.7.9) 

fi.L 

-  (V  -  q  (d  -  8l  i)"1  W)gL 

(13.7.10) 

13*7.2  Computational  Instructions 

Eq,  (l3.7,l)  gives  a  vector  U  aa  the  product  of  the  normative  covariance 
matrix  postmultlplied  by  the  ipaatizing  vector  V,  If  one  has  only  the  £ 
matrix  to  begin  with,  aa  in  the  case  of  ipsativo  personality  meaaurea,  then 
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on®  may  be  able  to  hypothesize  a  U  vector,  for  th®  computational  procedure 
requires  only  th®  U  vector  and  not  th®  R  matrix  a®  such. 

Eq.  (lj, 7*2)  give®  a  W  vootor  aa  th®  produat  of  th®  right  orthonormal 
of  £  and  th®  U  vootor  of  Eq,  (13.7*1)* 

Tho  next  stop  la  th®  calculation  of  tha  scalar  a  in  Eq,  (13*7*5)*  This 
is  tha  minor  product  of  tho  U  and  V  voctors. 

Tho  outor  limits  of  tho  first  basis  diagonal  of  R,  viz.  6^,  ar®  given 
by  Eqo.  (13.7.**)  und  (13.7.5)*  The  ^  value  assumes  that  th®  nonnativ® 
matrix  is  actually  a  correlation  matrix  so  that  its  trace  is  n,  th®  ordor 
of  tho  matrix.  Zt  is  well  known  that  this  trace  la  the  sum  of  th®  basic  di¬ 
agonals,  hence  6^  meat  be  loos  than  n. 

Eqo,  (13.7.6)  und  (13*7.7)  give  the  outer  limits  of  tha  remaining  8^ 
values. 

As  in  tho  solutions  of  the  previous  oectiono,  the  kth  approximation  to 
6^  is  given  by  ^  in  Eq.  (13.7.8). 

Eq,  (13.7.9)  gives  the  iteration  equation  for  the  8^  value®.  The  same 
procedure  is  used  for  narrowing  the  limits  of  the  8^' 0  as  in  th®  previous 
sections. 

It  is  to  be  noted,  however,  that  the  summation  gees  only  to  n-1.  This 
equation  also  differs  from  the  corresponding  equation  of  previous  sections 
in  that  the  right  hand  side  includes  the  £  and  a  terms  instead  of  "1”, 

Eq.  (13.7«10)  shows  the  calculations  for  the  Q  ,  vectors  of  the  basic 

♦  li 

or.thoiiovmal  of  R.  The  on  Hie  n*t.vr*m»  H ght-  la  a  inmunl  1 7.1  ng  scalar. 

13.7.3  Numerical  Example 

Tho  first  row  of  Table  13.7.1  gives  the  basic  diagonal  elements  5  of 
the  correlation  matrix  R,  as  calculated  from  Eqs,  (13.7,1)  through  (13.7.9). 


The  body  of  the  table  gives  tho  haala  orthonormal  of  H,  as  oa Imitated  from 
E<1»  (13,7,10,),  Note  that  this  matrix  Is  tho  transpose  of  tho  ono  In  Table 
liJjt.5,  Tho  valuos  In  tho  two  tablet*  agree  within  limits  of  decimal  aecumey, 
13.0  Mathematical  Troofa 

15,8,1  Dacia  Structure  and  Left  Centering 
Olven  the  matrix 

x  -  (I  -  Li')  X  (13.0.1) 

and 

x  *  PM'  (13.0.2) 

M'  -  (13.0.3) 

From  Eqa.  (13.0.1)  and  (13.0*3) 

x'  x  +  M  M'  -  X'  X  (13.B.M 

Let 

C  -  x'  x  (13.8.5) 

Q  -  X'  X  (13.0.6) 

From  Eqa,  (13«8.*0»  (13.0.5),  and  (13*0.6) 

C  +  H  M'  =.  G  (13.O.7) 

From  Eqa .  (13.O.2),  (13.8.3),  and  (13-8.7) 

Q  A2  Q'  +  M  M'  =  G  (13.8.8) 

Lot  us  now  find  the  roots  of  G. 

Assume  Q  la  vortical.  Let  Q  =•  ^  and  be  a  complement  of  t^.  In  particular. 


Tablo  l),\ 


3-7  W 

0.3701 

-0.3442 

-0.3037 

0.0)i33 

0.0154 

-0.003*; 

-0.1263 

0.4425 

0.6622 
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.1  -  Attain  Dlagonalii  ft,  and  Baalo  Orthonoroial  g1  ao  Dotermtnad  teem 
Attala  Otruature  of  g  and  from  R_V 


2.0U952 

1,33080 

0,4/443 

O,30q61 

0,34741 

0.28533 

0,21215 

0,160/0 

0.3821 

0.3991 

0,2869 

0,0392 

0.2673 

0.3308 

0.3177 

0.3693 

-0.334c 

-0,2066 

0.4532 

0.5197 

0,4845 

-0,0556 

-0,1159 

0.0235 

•0.2/88 

-0,3521 

-0.0563 

-0.1567 

-0,1633 

0.5093 

0.5385 

0.3195 

O.0O12 

-0.0129 

-0,1486 

0,1665 

0.1868 

0.4181 

0.2350 

-0,8214 

O.O/65 

-0,1403 

-O.7010 

0.2993 

0,4o8l 

-0,1850 

0.1134 

0.24 39 

0,05/2 

-0,0224 

0.1553 

0.2291 

-0.2644 

-O.6069 

0.6778 

-0,1479 

-0,0606 

0.2330 

-0.1740 

0,6618 

-O.605O 

O.2156 

-0.2014 

0.0626 

0,3106 

-0.7709 

0.1371 

O.I963 

-0.1694 

0.0624 

-0.1504 

0.0307 

-o.7>toa 

0.0716 

-0,0476 

0,0431 

0.0018 

-0.007 6 

0.0570 

-O.OO09 

wa  may  have 
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v«i 


(15.0.9) 


whora  ia  th«  partial  triangular  factor  of  tho  right  or  Eq,  (13,0,9), 
From  Eq,  (13,8,0)  w«  may  writa 


itl  -  0  (13.0.10) 


4 

» 

- 1 

O 

_ 1 

V 

■ 

l«>i  >  V 

t 

• 

O 

O 

1 _ _ 

i 

A 

+  M  M'  -  I 

where  ia  u  basic  vector  of  0, 
From  Eq.  (l3.0,lo) 


» 

■  O 

«*  m 

A2  0 

.  h 

0 

0 

i  % 

m  w  m 

M  M'  (\  ,  Q  ) 


I  0 


i.  0  ^ 1  j 


Hi 

J 


Q[ 

lqj. 


\i  * 


Lot 


(I3.fl.ll) 

“a  ■  v.i 

(13.8.12) 

V.i  ■  v.j 

(13.S.13) 

«;n  -  v( 

(13.8.  l't) 

5jm  ■  wi 

(13.8.15) 

(13.rt.1a)  »-hn>nf'i\  (m.0,1.**,)  in  (1.3. n.n)  ctv»» 
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■ 

-  0  I  0 

»  ■ 

V. 

■  « 

V  4 

m  • 

0 

1 

(V',  V.) 

*1 

• 

0  .0  I 

.  ■ 

.VJ . 

0 

»  m 

(13.8.16) 


From  Eq.  (13.8.1 6) 


rvt  1 

■(A2-0I)'1  0  * 

r  vt  1 

F 0 " 

#* 

.V-J . 

+ 

0  -I; 

1 

V. 

<VI  \l  ♦  VS  V  *  1  0 

L  0 . 

.  6  . 

L  J 

(13.8.17) 

Frcra  Eq.  (13.8.17) 

vi  v. 

1  +  v'  (az  -  0  I)'1  V4  +  JLJ.  .  o  *  (13.8.18) 

In  particular,  If  c  la  basic,  then  Eq.  (13.8.18)  becomes 


1  +  V'  (a2  -  0  l)’1  V  ■  o 


(13.8.19) 


where  i  Is  dropped  frcra  V^. 
Or,  in  scalar  notation. 


1  + 


-  0 


a2  -0 


+  K—2— 

K  "  0 


(13.8.20) 


where  the  V's  in  the  numerators  of  Eq,  ( 13. 8,20)  are  the  elements  of  V  in 
Eq.  (13.8.19). 

To  solve  for  the  kth  root  0^  in  Eq.  (13,8.20)  we  consider 


V2  v2  v2 

F  “  1  +  B.  -  z  +  6.  -  z  +  +  £ -  £ 

x  2  n 


(13.8.21) 


We  con  now  prove  that  a  root  of  F  lies  between  5,j+^  and  B^,  As  2  approaches 
8^^  frcra  above,  F  -» •»  ,  and  as  it  approaches  8^  frcra  below,  T  -*w  , 
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From  Eq.  (13,0,13) 

»#k  -  QVk  (13.6,20) 

and 


(13.6.29) 


The  proof  for  the  left  centered  matrix  frera  that  of  the  uncontered  matrix 
follows  similar  lines# 

13.6.2  Proof  of  Sasic  Structure  and  Right  Centering  Xpsativo  from  Normative 
Sasic  Structure  {Victors 

Let  R  be  the  basic  normative  covariance  or  correlation  matrix  and  £  the 
ipaatlve  covariance  matrix  so  that 


p  -  (I-VV')R(I.T  V') 


(13.6.30) 


where 

V'  V  -  1  (13.6.31) 

Let.  tho  Ivtnlf  nhrtiotiuvo  of  R  atwI  £,  if  apeo  lively,  be 

R  -  q  B  q'  (13.8.32) 

and 

p  »  qdq'  (13.8.33) 

From  Eqa.  (13.O.30),  (13.8.32),  and  (13.3.33) 

qdq'  »  (I  -VV')  q8  Q'  (i  -W')  (13.0.3J0 


y> 


Uooauae  of  Eq,  (13,8,30) 

V'  4  -  0  (13.0.53) 

From  Eqs.  (13.8.34)  and  (13.3.35) 

q  d  -  (I  -  V  V')  Q6  a>  q  -  0  (13.0.30) 

Fran  Eq.  (13.8.36) 

Q'  q  <1  .  (I  •  A'  V  V'  Q)  M'  <i  -  0  (13.0,37) 

Fran  Eq.  (13.0.37) 

fl  Q#  q  -  Q#  4  d  -  Q'  V  V#  Q  6  q  -  O  (13.0.30) 

From  Eq.  (13.6. 30) 

Q'  -  (ft  -  dt  I)’1  q'  VV'  Q8Q'  q§1  -  O  (13.0.39) 

From  Eq,  (13.0.39) 


(V'  Q  8)  Q'  q  1  -  (V'  q  5)  (6  -  d.  l)'1  Q'  V  V'  q  5  Q'  q  .  -  0 

•  *  J»  tl 

or 

v'  q  8^  (5  -  dt  I)'1  q'  v  -  1  -  0  (13.8.40) 

Fran  Eq.  (l3.8.4o)  we  solve  for  the  d^  aa  in  the  case  of  the  raw-nonnative 
methods.  Having  solved  for  the  basic  diagonal,  we  can  solve  for  the  basic 
orthononnal  of  £  from  Eq.  (13.0.39).  We  have 

q,t  -  Q  (b  -  dt  i)'1  q'vg 


(13.8.41) 
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vhoro  ^  is  a  normalizing  acalur, 

Hormativo  frai  ipoativo  bauio  atruatura  fnotoro. 

Prom  Eqo,  (13.0,34)  and  (13,8,35)  wo  havo 

4  V  Q  •  V  Q  6  (I  ■  Q'  V  V'  Q)  ■  0  (13.0.42) 

Stoa  Eqa,  (13.8,32)  and  (13,8,42) 

Q  ,  ■  q'  Q  ,  8,  m'  R  v  v'  q  ,  -  0  (13.0.43) 

FtowBl.  (13.0.43) 

q'  Q  .  +  (d  -  8.  I)’1  q'  RVV'  Q  .  -  0  (13.0.44) 

From  Eq.  (13.8,44) 

<1  « l 1  Q#1  +  q  (d  -  6t  I)’1  q'  RVV'  »  0  (13.8.45) 

It  can  bo  provod  that 

q  q'  -  I  «  V  V'  (13.0.46) 

From  Eqo.  (13.8.45)  and  (13.8.46) 

Q  .  -  V  V'  Q  .  +  q  (d  -  5.  I)'1  q'  R  V  V'  Q  .  -  0  (13.8.47) 

•  1  •  !  1  •! 


Promultlplylng  Eq.  (13.8.4/)  by  V'  R  fllvon,  Ivonww*  or  Eq.  (13.8,32), 

V'  0,.  8.  -V'  RVV'  q,  +V'  Rq(d  .5.  if  q'  RVV'  q.  «  0 
or 

V'  R  q  (d  -  at  l)‘x  q'  R  V  +  8t  -  V'  R  V  -  0  (13.0.43) 


If  vo  have  the  vector  R_V  \»  can  solve  E,j.  (lJ.G, 1>0)  fop  the  6  'a  by 
methods  analogous  to  tha  previous  methods  since  wa  can  readily  show  that 

dl  -  8i+l  *  8i  (U.a.»t9) 

We  atlll  need  an  upper  bound  for  however* 


We  can  oolve  for  the  Q  by  rewriting  Eq.  (lj.0,4/)  aa 
<5,1  “  (V  -  q  (d  -  6t  if  q'  RVjgj 


(13.8.50) 


where  gi  is  a  normalizing  ocalar. 


CHAPTER  IV 

CATEGORICAL  VARIATION)  IN  FACTOR  ANALYOW 

Zn  the  previous  chapters  we  have  rogarded  data  matrices  aa  oonaiatlng 
eaaantlally  of  measures  for  a  given  number  of  entitiea  on  eaoh  of  a  differ¬ 
ent  number  of  attributea,  Thia  type  of  data  matrix  baa  been  the  one  moat 
commonly  uaed  in  factor  analytic  atudiea.  You  recall,  however,  that  in 
eeverul  cbaptera  we  Indicated  that  in  acme  caaea  the  attributea  might  have 
a  natural  origin  of  measurement.  For  example,  in  the  prevloua  chapter  we 
euggeetod  that  the  entitiea  night  be  peraona  practicing  typewriting  and 
the  attributea  might  be  auccoaaive  time  intervals. 
lV.l  Multicategory  Seta 

Wo  may,  however,  conalder  a  somewhat  more  general  model.  For  example, 
suppose  that  we  have  a  number  of  individuals  for  each  of  whom  a  number  of 
physiological  and  psychological  variables  were  measured  on  each  of  a  number 
of  successive  days  or  time  intervals.  For  such  a  set  of  data  we  have  three, 
rather  than  two,  categories  to  consider.  In  the  conventional  case  we  have 
entitles  and  attributes  only.  In  this  more  general  case  we  have  entities, 
attributea,  and  occasions.  Let  us  now  consider  possible  ways  of  studying 
data  of  this  type. 

14.1.1  The  Attribute-Entity  Sets.  In  the  case  of  the  three  category 
Bet,  we  may  consider  a  number  of  matrices  of  the  conventional  type  consist¬ 
ing  of  attributes  as  columns  and  entities  as  rows.  Each  of  these  matrices 
would  have  the  same  attributes  and  entitles  for  a  number  of  different  oc¬ 
casions.  Wo  may  call  those  matrices  slabs  of  the  three  category  data  matrix 

The  problem  of  how  to  handle  such  a  set  of  data  by  means  of  factor 
analytic  technique  is  one  which  has  not  been  thoroughly  explored.  Horst 
(1963)  has  recently  discussed  the  general  problem  of  multicategory  sets  of 


data  and  proposed  several  dlfforont  ways  of  analyzing  such  sets,  Tuokar 
(1963)  also  has  considered  tha  general  problem  of  entities,  attributes, 
and  occasions  in  what  he  calls  the  three  mode  factor  analysis  model*  He 
has  presented  an  ingenious  procedure  for  conceiving  of  a  three  category 
set  of  data  in  terms  of  what  be  calls  a  core  matrix,  which  includes  the 
categories  of  entities,  attributes,  and  occasions*  The  method  assumes 
lower  orders  for  each  of  these  categories  than  are  represented  in  the  data 
matrix  and  the  problem  then  is  to  solve  for  this  lower  order  three  category 
matrix  as  a  basis  for  reproducing  the  observed  three  category  data  matrix. 

Wo  may  consider  a  simpler  way  of  handling  data  of  this  type  as  a  two 
category  sot.  Here  the  analysis  of  the  data  would  be  amenable  to  the  tech* 
nlquea  which  we  have  discussed  in  the  previous  chapters. 

The  first  of  these  ways  of  considering  the  data  is  to  regard  each  oc¬ 
casion  for  each  attribute  as  a  distinct  attribute.  Thus  we  would  regard  an 
attribute  measured  today  for  a  group  of  entitles  as  different  frea  the  some 
attribute  measured  tomorrow  on  the  same  entities.  For  example,  the  variable 
of  typewriting  speed  on  Monday  for  individual  A  and  the  variable  of  type¬ 
writing  speed  on  Tuesday  for  the  some  individual  would  be  regarded  as  two 
different  variables.  We  would  then  consider  a  supermatrix  in  which  the  en¬ 
tity-attribute  slabs  would  be  strung  out  in  such  a  way  that,  if  we  had  4 
occasions  and  10  attributes,  the  aupermatrix  would  actually  have  10  x  4, 
or  40,  attributes.  We  would  therefore  have  a  4o-variable  matrix.  We  may 
then  consider  a  factor  analysis  of  such  a  matrix  along  the  lines  outlined 
in  the  previous  chapters.  This  could  be  solved  for  principal  axis  factor 
loadings  for  each  variable  or  attribute  on  each  occasion. 


Another  way  of  regarding  the  sum  sat  of  data  would  be  to  consider  aach 
occasion  aa  a  different  set  of  entities.  This  would  wean  that  the  person 
whose  typewriting  speed  Is  recorded  today  will  be  considered  a  different  per 
son  when  his  speed  Is  recorded  tomorrow,  even  though  he  has  the  asm*  name 
and  la  Identifiable  aa  the  come  Individual.  If  we  look  at  the  problem  In 
thlo  way,  we  could  thon  string  out  the  entity ‘attribute  slabs  for  the  vari¬ 
ous  occasions  so  that,  If  we  had,  say,  20  persona  and  4  occasions,  we  would 
actually  now  havo  GO  different  persons  since  we  regard  each  individual  as  a 
different  person  on  each  of  the  4  different  occasions*  This  would  give  us 
a  supermatrix,  or  a  column  type  3  supervector,  In  which  each  of  the  natrla 
elements  la  an  entity-attribute  matrix  for  a  specific  occasion.  Here  we 
would  have  Go  entities  and  10  attributes.  We  con  now,  on  a  matrix  of  this 
type,  do  a  factor  analysis  according  to  procedures  described  In  previous 
chaptars.  Such  an  analysis  could  then  ylold  a  sot  of  factor  scores  for 
each  person  on  each  of  tho  4  different  occasions.  It  would  also  yield  a 
set  of  factor  loadings  for  each  of  tho  10  variables. 

It  will  be  seen  that  the  first  and  the  second  ways  of  setting  up  the 
matrices  of  data  in  the  form  of  type  3  supervectors  yield  essentially  dif¬ 
ferent  results.  In  the  first  case  we  get  a  factor  score  matrix  for  the  20 
entitles  and  we  get  factor  loading  matrices  for  the  10  attributes  on  each 
of  4  different  occasions.  In  the  second  case  we  get  a  factor  score  matrix 
for  the  entitles  on  each  of  the  4  different  occasions  and  a  factor  loading 
matrix  for  the  10  attributes.  In  the  one  case  ve  regard  the  occasions  as 
different  variables,  and  in  the  second  we  regard  them  ns  different  entities. 

14.1.2  The  Attribute-Occasion  Set.  In  the  previous  example  we  have 
considered  the  decomposition  of  the  data  cube,  as  it  were,  into  occasion 
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•iabs  such  that  each  slab  had  ontitiaa  for  rows  and  attribute*  for  columns. 
Wt  may  now  aonaldtr  a  dlffaront  daoompoaltlon  of  this  throo  dimensional 
matrix  auah  that  each  alab  rsprssants  a  parson.  Each  parson  matrix  may  bt 
regarded  aa  consisting  of  occasion  rows  and  attribute  columns,  Wa  would 
than  have,  using  tha  previous  oxaraple,  twtnty  4  x  10  matrloas. 

Wa  now  hava  two  obvious  oltarnatives  of  treating  thasa  slabs  of  data. 

In  tha  first  of  thasa,  wa  could  string  out  tha  slabs  into  a  row  typa  2 
suparvactor  so  that  aaoh  parson  is  regarded  as  a  different  attribute.  Ohara 
fora  wa  would  have  a  supermatrix  of  4  occasions  and  10  x  20,  or  200,  attri¬ 
butes.  On  such  a  matrix  one  could  then  perform  a  factor  analysis. 

On  the  other  hand,  wo  may  string  the  matrices  in  tha  other  direction, 
so  that  each  person  is  considered  e*  a  different  occasion.  We  would  there¬ 
fore  have  a  matrix  with  00  rows  and  10  columns.  We  recognize  at  once  that 
this  arrangement  of  the  data  is  the  same  as  the  second  way  of  arranging  it 
in  the  previous  method,  except  that  there  has  been  an  interchange  of  rows. 

In  both  methods  the  columns  are  the  10  attributes,  but  the  entities  for  a 
single  occasion  are  grouped  togethor  in  rows.  In  the  second  case  we  have 
the  soma  10  attributes,  but  the  occasion  rows  are  grouped  for  a  specific 
entity.  We  see,  therefore,  that  we  actually  have,  so  far,  three  different 
ways  of  arranging  the  data  into  a  row  by  column  data  matrix  which  can  be 
factor  analyzed  by  available  methods. 

14.1.3  The  Entity-Occasion  Pair  or  Set.  Let  us  now  see  what  happens 
if  we  take  the  third  remaining  possibility  of  decomposing  the  data.  In  the 
first  case  we  took  slabs  such  that  each  slab  was  a  different  occasion.  In 
the  second  case' we  took  slabs  such  that  each  alab  was  a  different  person  or 
entity,  and  in  the  third  case  we  take  slabs  from  the  cube  so  that  each  slab 


it  a  different  Attribute, 

In  thie  latter  case,  eaah  slab  nay  be  regarded  ae  having  entitiee  for 
rows  and  oooasions  for  columns.  Suppose  we  string  these  slabs  out  into  a 
row  suporveotor  so  that  the  SO  entitles  constitute  the  rows,  and  the  col¬ 
umns  are  sets  of  occasions  for  each  of  the  successive  attributes.  We  recog¬ 
nize  at  once  that  this  Is  the  first  arrangement  considered  in  the  attribute- 
entity  slabs,  except  that  occasions  are  grouped  by  attributes,  while  in  the 
firat  case  attributes  were  grouped  by  successive  occasions# 

Obviously  then,  since  a  data  matrix  of  this  type  has  simply  undergone 
a  right  hand  permutation  of  the  former  type  of  data  matrix,  the  factor  analy¬ 
sis  results  would  be  the  same  except  for  the  permutation  of  columns'  in  the 
data  matrix  and  the  corresponding  permutation  of  rows  in  the  factor  loading 
matrix. 

Let  us  see  now  what  happens  if  we  string  these  entity-occasion  slabs 
in  a  vertical  manner  so  that  in  the  column  supervector  we  have  occasions 
for  columns,  and  the  rows  consist  of  entitles  grouped  by  successive  attri¬ 
butes,  We  see  that  this  gives  the  eame  result  as  whan  the  attribute -occasion 
set  is  arranged  in  the  vertical  supermatrix,  except  that  now  the  aubmatrices 
exhibit  grouping  of  entities  according  to  successive  attributes  rather  than 
grouping  of  attributes  according  to  successive  entities.  It  is  therefore 
clear  that  nothing  new  has  been  added  by  reordering  of  the  data  into  entity 
by  occasion  slabs.  The  factor  analysis  of  such  on  ordering  of  the  data 
would  be  the  same  as  for  the  second  case  involving  the  attribute-occasion 
set. 

14.1.4  Additional  Categories,  In  the  previous  section  we  have  con¬ 
sidered  what  may  be  regarded  as  the  most  obvious  categories  in  sets  of  data 
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to  bo  obtained  in  real  lifo  situation**  Tboso  are  certainly  important,  and 
it  io  probable  that  a  great  deal  more  attention  will  be  given  to  the  three 
category  type  of  data  matrix  and  to  efficient  methods  of  reproducing  euah  a 
eet  of  observed  data  with  a  smaller  number  of  parametersi  This  would  con¬ 
stitute  a  generalization  of  the  lower  rank  approximation  to  data  matrices  of 
the  two  category  type.  However,  it  is  already  becoming  dear  that  even  the 
three  oategory  type  of  data  matrix  will  not  cover  all  meaningful  categories 
encountered  in  important  psychological  research* 

Lot  us  consider  a  specific  example.  Suppose  we  have  a  questionnaire 
with  a  set  of  64  items  to  which  18  individuals  will  respond.  Let  us  assume 
that  these  entitles  or  individuals  are  requested  to  give  responses  under  a 
number  of  different  conditions  or  instructions.  For  example,  they  may  be 
asked  to  respond  to  the  items  as  they  apply  to  themselvos,  to  the  average 
person,  to  the  ideal  person,  to  the  respondent  as  he  would  like  to  be,  etc. 
One  may  have  as  many  different  conditions  as  he  can  Invent. 

Let  us  assume  that  thore  are  eight  of  these  conditions.  Suppose  the 
respondents  are  a  group  of  psychiatric  residents  in  a  mental  hospital.  It 
may  be  expected  that  these  residents  are  undergoing  training  and  experience 
which  will  modify  their  responses  to  the  items  over  a  period  of  time  for 
the  varying  conditions.  Suppose,  then,  that  these  individuals  are  requested 
to  repeat  the  8  sets  of  responses  to  each  of  the  64  items  on  4  different  oc¬ 
casions  at  six  month  intervals. 

Let  us  now  review  the  essential  characteri sties  of  this  data  model. 
First  we  have  sets  of  matrices  involving  18  entities  and  64  attributes  or 
variables.  For  each  condition  on  each  occaoion  we  have  such  a  matrix.  For 
example,  if  we  have  8  conditions  and  4  occasions,  this  means  that  we  have  32 
matrices  of  order  18  x  64. 


Ws  may  also  oonosivs  of  an  additional  categorical  sat  which  would  con* 
•lit  of  a  aat  of  Instrument#  or  evaluators,  Thl«  would  lnvolva  a  number  of 
different  ways  of  evaluating  or  measuring  each  attribute  for  each  entity 
under  each  condition  and  on  each  occasion#  It  Is  interesting  to  note  that 
the  Instrument  and  the  occasion  categories  ore  the  basic  concepts  Involved 
In  traditional  theories  of  reliability  of  measures#  The  instruments  corres* 
pond  to  comparable  form  or  comparable  measure  reliability,  and  the  occasions 
correspond  to  consistency  or  stability  over  time# 

In  most  of  the  measurement  models,  comparable  form  reliability  usually 
Involves  only  two  instruments.  Thane  instruments  may  be  persons,  test  book¬ 
lets,  hardware,  or  what  not.  For  example,  we  may  have  a  number  of  different 
ratorc  evaluating  the  same  individual  on  the  same  attribute  for  a  given  oc¬ 
casion.  In  the  aaae  of  the  occasion  category,  we  have  a  special  case  of  re¬ 
test  reliability  which  ordinarily  involves  only  two  occasions.  The  problem 
of  evaluating  change,  for  example,  becomes  sufficiently  complicated  from  the 
model  point  of  view  even  if  we  have  only  the  four  categories  of  entitles, 
attributes,  conditions,  and  occasions.  It  becomes  even  more  complex  if  ve 
Include  also  the  additional  category  of  Instruments.  In  any  case,  It  is 
reasonable  to  assume  that  a  general  data  model  which  is  completely  satisfac¬ 
tory  should  be  prepared  to  handle  at  least  a  five  category  matrix. 

Even  though  we  cannot  present  a  complete  analysis  of  the  more  general 
problem.  It  may  be  worthwhile  to  examine  the  possibilities  of  arrangements 
for  multicategory  sets  of  data  in  two  dimensional  arrays  which  would  be 
amenable  to  the  conventional  methods  of  factor  analysis. 

First  we  may  summarize  the  possibilities  with  throe  category  sets.  We 
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indicate  these  by  A,  0,  and  0,  respectively, 

(A),  <B,C) 

<B),  (A,C) 

<C),  (A,B) 

Fig.  14.1.1 

We  see  in  Fig.  14.1.1  how  ve  may  arrange  this  set  of  data  into  three 
different  kinds  of  two  dimensional  sets.  The  first  set  would  have  the  A 
category  for  rows  and  the  0  and  0  categories  for  columns.  The  next  set 
would  have  the  B  category  for  rows  and  the  A  and  C  categories  for  columns. 
The  third  set  would  have  the  C  category  for  rows  and  the  A  and  B  categories 
for  columns,  A  review  of  the  previous  subsection  will  show  that  this  con- 
stitutes  the  three  independent  ways  In  which  the  data  can  be  ordered  in 
terns  of  two  dimensional  arrays.  Any  other  arrangement  would  constitute 
repetitions  of  those,  except  for  transposition  or  permutation  of  the  matri¬ 
ces.  Obviously,  such  operations  on  a  matrix  would  not  affect  its  basic 
structure,  except  for  transposition  of  the  basia  orthonormals  or  permuta¬ 
tion  of  rows  and  columns* 

Suppose  now  we  have  four  sets  of  categories  such  as  entities,  attributes 
occasions,  and  conditions,  which  we  designate  A,  B,  C,  and  D,  respectively. 
Fig.  14,1.2  indicates  the  ways  in  which  these  four  categories  can  be  arranged 
in  two  dimensional  array  matrices. 
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(A) ,  (D,0,D) 

(B) ,  (A,C,D) 

(e),  (a,b,d) 

(D),  (A,B,C) 

<A,B),  <C,D) 

(A,C),  (B,D) 

(A,D),  (B,C) 

rig.  itf.1.2 

It  will  be  noted  that  Fig.  14.1.2  la  divided  into  two  parts.  The  first 
part  indicates  those  arrangements  involving  only  one  categorical  set  as  rows 
and  three  categorical  sets  as  columns.  The  second  put  of  the  figure  shows 
how  the  two  dlraonsional  aubmatricoa  may  be  arranged  into  seta  so  that  the 
rows  will  consist  of  two  of  the  categories  and  the  columns  of  the  other  two 
categories. 

Note  that  in  the  first  part  of  the  figure  the  first  arrangement  has 
the  members  of  the  A  category  for  rows  and  the  B,C, and  D  categories  for  col¬ 
umns,  The  particular  arrangement  or  permutations  of  the  B,  C,  and  D  cate¬ 
gories  is  irrelevant.  It  must  be  remembered  that  the  notation  used  here 
does  not  mean  that  first,  all  of  the  B  category  columns  are  given,  then  all 
of  the  C  categories,  and  finally  the  D  categories.  There  would  presumably 
be  some  hierarchical  order  of  groupings  and  oubgroupings,  but  these  are  ir¬ 
relevant  since  these  various  hierarchical  arrangements  can  be  produced  by 
permutations  of  columns. 

The  second  arrangement  has  the  members  of  the  B  categories  for  rows, 
and  members  of  the  A,  C,  and  D  categories,  respectively,  for  columns.  Here 


again  the  order  of  A,  C,  and  D  ara  irrelevant  aa  far  aa  a  factor  analytic 
aolutlon  la  oonaarnad.  Tha  third  arrangement  haa  tha  0  category  for  rove 
and  tha  A;  B,  and  D  catagoriaa  for  column*,  Finally,  tha  fourth  arranga¬ 
nant  haa  tha  D  category  for  rova  and  tha  A,  B,  and  0  catagoriaa  for  columna. 

Next  ve  conaidor  tha  aeaond  part  of  Fig*  14.1,2  in  vbloh  ve  have  two 
catagoriaa  for  rova  and  tvo  catagoriaa  for  oolumna*  Rare  ve  aaa  in  tha 
flrat  row  that  tha  A  and  B  oategoriee  ara  uaed  for  rova  and  tha  0  and  D 
catagoriaa  for  columna.  Again,  tha  ordering  of  tha  membare  of  tha  A  and  B 
catagoriaa  ia  irrelevant,  alnoa  they  may  be  permuted  at  vlll  by  a  left  hand 
pernutation  matrix,  She  eaco.id  arrangement  haa  the  A  and  C  catagoriaa  for 
rova  and  tha  B  and  D  catagoriaa  for  columna.  The  laat  arrangement  in  tha 
aocond  part  of  Fig.  14,1,2  haa  tha  A  and  D  catagoriaa  for  rova  and  tha  B 
and  C  catagoriaa  for  columna. 

It  can  be  eeen  that  no  other  arrangements  exist  involving  tvo  categor¬ 
ies  for  rova  and  tvo  for  columns,  vhich  are  not  either  transpositions  or 
permutations  of  the  matrices  indicated  in  the  lover  part  of  Fig,  14.1,2, 

Any  other  combination  of  tvo  categories,  not  involving  A,  vhich  might  be 
used  for  rovs  would  actually  constitute  a  transposition  of  those  already 
Indicated.  For  example,  if  B  and  C  were  used  for  rows,  then  A  and  0  would 
be  used  for  columns,  and  one  would  have  the  transpose  of  the  third  case  in 
the  second  part  of  Fig.  14.1.2. 

We  see  now  that  there  are  actually  seven  different  ways,  not  involving 
transpositions  or  permutations,  in  vhich  the  four  category  data  model  can  be 
arranged  into  2x2  arrays.  Any  of  these  may  have  a  conventional  factor 
analysis  performed  upon  it  bo  as  to  get  a  basic  structure  solution  or  some 
other  approximation  or  transformation  of  a  basic  structure  solution.  Any 


of  these  arrangement*  admit  of  «  lover  rank  approximation  solution* 

One  relevant  and  interesting  question  is  whioh  of  these  arrangesientB 
is  best  from  the  point  of  view  of  providing  the  most  parsimonious  approxi¬ 
mation  to  the  data*  It  should  be  noted;  for  example,  that  if  ve  have  only 
three  occasions,  and  ve  let  this  be  indicated  by  D,  the  last  arrangement  in 
the  first  part  of  Fig*  14*1.2  has  only  three  rovs*  A  lover  rank  approxima¬ 
tion  to  this  matrix  could  obviously  not  be  greater  than  tvo* 

One  criterion  vhich  could  be  useful  in  deciding  vhat  arrangement  would 
give  the  greatest  possibility  for  parsimonious  description  of  the  data  would 
be  to  consider  which  combination  of  all  possible  seven  indicated  in  Fig. 
14*1.2  would  result  in  a  tvo  array  matrix  such  that  its  smaller  dimension 
would  be  a  maximum.  Let  us  take,  for  example,  the  illustration  used  in  the 
previous  section  in  vhich  we  had  18  persons,  64  attributes,  8  conditions, 
and  3  occasions.  Suppose  ve  designate  these  as  categories  A,  B,  C,  and  D, 
respectively.  Obviously,  the  arrangement  here  whose  smallest  dimension  la 
a  maximum  would  be  A  and  C  as  rows  and  B  and  D  as  columns.  Then  the  smaller 
dimension  would  be  8  x  18  or  144.  This,  however,  is  only  one  consideration 
in  deciding  what  arrangement  to  use,  and  the  problem  of  interpreting  the  re¬ 
sults  still  remains. 

Lst  us  now  see  what  happens  if  we  have  five  categorical  sets,  say,  A, 

B,  C,  D,  and  B.  Those  may  in  particular  be  the  sots  of  entities,  attributes, 
conditions,  evaluations,  and  occasions  discussed  in  the  previous  example. 
Since  there  are  five  categorical  sets,  these  can  obviously  be  arranged  so 
that  one  of  the  dimensions  includes  one  set,  and  the  other  dimension  includes 
the  remaining  four,  as  indicated  in  Fig.  14*1*3. 
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(A),  (B.C.D.E) 

<B),  (A.O.D.B) 

(C) ,  (A.B.D.R) 

(D) ,  (A.B.C.E) 

(E) ,  (A.B.C.D) 

Fig.  14.1.3 

Here  again,  we  can  without  lost  of  generality  take  the  row  dimension  as  the 
one  having  a  single  category.  The  data  can  also  be  arranged  so  that  one  di¬ 
mension  has  two  seta  and  the  other  has  three  sets,  as  in  Fig.  14.1.4.  It  is 
Irrelevant  which  dimension  has  the  three  categories  and  whloh  has  the  two. 
so  that  without  loss  of  gsnerality  we  may  take  the  row  dimension  as  having 
the  two  categories. 

We  may  now  examine  in  greater  detail  the  case  of  the  one  category  row 
arrangement  in  Fig.  14.1.3.  We  take  each  of  the  categories  in  turn  as  the 
row  dimension  and  the  other  four  as  the  column  dimensions  of  the  two  array 
matrix.  Again,  it  must  be  remembered  that  the  sequence  of  the  symbols  in 
parentheses  is  not  relevant,  that  only  the  symbols  themselves  are  important. 
One  may  have  any  hierarchical  order  desired.  To  adopt  &  convention,  one  may 
assume  that  the  hierarchical  order  progresses  from  left  to  right  so  that  the 
E  category  is  the  final  or  top  hierarchy  for  the  first  four  arrangements  in 
Fig.  14.1.3.  This  implies  a  number  of  submatrices,  each  of  which  may  be  a 
supermatrix,  such  that  each  successive  submatrix  corresponds  to  each  succes¬ 
sive  member  of  the  E  category. 

Let  us  now  examine  the  two  category  by  three  category, two  dim.  nsional 
array  matrix  arrangements  indicated  by  Fig.  14.1.4. 
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M, 

(0,D,E) 

M, 

(B,D,B) 

(A,D), 

(B,M) 

(B,0,D) 

(A,D,B) 

<B,D), 

(A, 0,8) 

<B,E), 

(A,C,D) 

(C,D), 

(A,B,B) 

(C,E), 

(A,B,D) 

(D,E),  (A,B,C) 
Fig.  14.1.4 


We  can  vary  simply  set  forth  the  rules  for  specifying  the  various  arrange¬ 
ments  by  noting  that  the  dimension  having  two  categories  can  be  made  up  by 
considering  all  possible  different  pairs  of  the  two  categories.  This  will 
obviously  be  10,  as  Indicated  in  the  figure,  because  this  is  the  number  of 
five  things  taken  two  at  a  time.  The  column  categories  will,  of  course,  be 
the  three  categories  not  represented  in  the  row. 

We  now  have  the  general  problem  of  deciding  which  of  these  arrangements 
would  be  beat  for  analyzing  the  data  of  three  or  more  categorical  sets  in 
terns  of  a  two  dimensional  array  matrix  amenable  to  the  factor  analytic  tech¬ 
niques  set  forth  in  earlier  chapters.  It  would  doubtless  be  of  interest  to 
investigate  the  properties  and  to  attempt  interpretations  of  the  various  ways 


in  whioh  tht  data  otn  be  laid  oat  in  a  two  dimensional  matrix*  Zt  i»  probabla 
that  simplifying  or  unifying  relationships  among  these  various  msthods  may  be 
established* 

14*2  Considerations  of  Origin 

In  the  previous  chapter  we  have  given  attention  to  the  problem  of  origin 
of  measurements  and  have  discussed  in  part  the  problem  of  scale*  We  have 
seen  how  the  basic  structure  of  a  matrix  varies  as  we  perform  either  a  right 
or  a  left  centering  operation.  We  shall  now  consider  the  relationship  of 
the  mettle  problem  to  the  multi  category  data  model  which  wo  have  just  dis¬ 
cussed. 

In  general,  any  of  the  data  arrangements  considered  in  Fig.  14.1.1, 
14*1.2,  14.1.5,  and  14*1.4  must  face  the  problem  of  metric.  Whether  we 
should  have  raw  score  measures,  deviation  measures,  or  standard  deviation 

measures,  and  to  what  extent  these  separate  considerations  apply  to  sub- 

•  * 

matrices  within  the  set,  must  be  decided.  Ordinarily,  if  we  have  a  three 
category  entity-attribute -occasion  matrix,  we  may  assume  that  the  difference 
in  variance  and  mean  for  a  given  attribute  over  a  given  number  of  individuals 
from  one  occasion  to  the  next  would  be  of  interest  in  the  analysis  of  the 
data.  Considering,  therefore,  the  entity-attribute  matrix  for  each  occasion 
slab,  we  would  not  standardize  the  measures  by  columns.  Such  operations 
would  obviously  lose  information  as  to  relative  changes  or  variations  over 
time  for  the  entities  with  respect  to  each  oi  these  attributes. 

If  we  take  the  second  arrangement  in  Fig,  14.1.1,  in  which  B  is  the 
attribute  category  and  A  and  C  are,  respectively,  entities  and  occasions, 
we  might  well  take  standard  deviation  measure*  tth  respect  to  the  attributes, 
since  these  could  be  a  number  of  different  kinds  of  things  which  were  not 
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measured  In  comparable  unit*  or  fro#  comparable  origin*.  If  th*  centering 
and  aoallng  vara  dona  over  all  oocaalon*  for  all  th*  entitle*,  va  could  aa* 
how  relative  naana  and  variance*  fluctuated  for  a  a Ingle  attribute  ovar  th* 
varloua  condition*. 

It  nay  be  that  th*  problem  of  metric  with  respect  to  multi  category  data 
matrlcea  may  beat  be  raaolvad  by  eonaldarlng  thoa#  arrangement*  which  involve 
only  attribute*  and  evaluator*  aa  the  row  categoriea.  For  thoa*  arrangement* 
on*  would  atandardie*  by  row*.  Thla  would  allow  difference*  in  origin*  and 
variance*  to  ahov  up  with  reapeot  to  changing  condition*  and  occaalona,  and 
would  auppreaa  th*  difference*  due  to  th*  arbitrary  metric  generally  charac¬ 
teristic  of  attribute*  and  evaluator*.  Once  th*  data  have  been  atandardized 
for  these  arrangements,  they  can  be  rearranged  according  to  other  patterns 
indicated  In  Figs.  14.1.1  through  14.1.4. 

14.3  Computational  Considerations 

Once  of  the  problems  which  frequently  arises  and  which  has  led  to  a 
great  deal  of  confusion  Is  that  of  determining  under  what  conditions  it  la 
desirable  to  factor  entities,  and  under  what  conditions  attributes. 

Suppose  we  have  a  two  category  array,  irrespective  of  what  the  cate¬ 
gories  might  be.  They  might  be  entitles  and  attributes,  as  in  the  convention 
al  case)  they  might  be  entities  and  occasions}  or  they  might  be  attribures 
and  occasions,  as  in  the  case  of  the  Blngle  individual  who  now  represents 
a  complete  population  or  universe.  With  any  of  these  two  dimensional  matri¬ 
ces  we  may  get  either  a  major  or  a  minor  product  moment  matrix  after  apply¬ 
ing  some  appropriate  operations  to  achieve  a  specified  metric.  This  may 
consist  of  either  right  or  left  centering  or  both}  or  it  may  also  include 
scaling  the  members  of  a  category,  whether  they  are  entities,  attributes,  or 
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conditions,  by  means  of  multiplication  by  a  diagonal  matrix  on  althar  tha 
right  or  l«ft  or  both* 

It  la  oartalnly  trua  that  tha  baaia  atruotura  of  auoh  matrioaa  will  ba 
vary  much  a  function  of  tha  kinds  of  aoaling  and  origin  ralooating  opa ra¬ 
tions  that  bava  baan  parformad  upon  it.  Howavar,  it  doss  not  saam  to  ba 
ganarally  racognlzad  that,  for  any  givan  sat  of  matriolsing  operations— 
that  is,  for  any  givan  sat  of  oparationa  by  whioh  wa  apply  additiva  and 
sealing  oonstanta  to  rows  or  columns  or  both,  it  doas  not  mattar  whathar 
wa  faator  ona  sat  of  eatagorias  or  tha  other.  If,  for  axoapla,  wa  hava  a 
data  matrix  whieh  wa  standardize  by  parsons  or  by  columns,  lat  us  say,  wa 
may  gat  tha  minor  product  moment  of  this  normalized  data  matrix  and  perform 
a  basic  structure  analysis  on  it.  This  will  give  ua  a  factor  loading  matrix 
by  moans  of  which  we  can  solve  for  a  principal  axis  or  basic  structure  faotor 
score  matrix  as  indicated  in  Chapter  U. 

On  the  other  hand,  we  can  get  a  major  produot  moment  of  this  matrix 
and  perform  a  basic  structure  analysis  on  it.  The  basic  structure  analysis 
will  give  us  precisely  the  factor  score  matrix  that  we  obtained  previously 
by  getting  first  the  factor  loading  matrix  and  then  solving  for  tha  factor 
score  matrix. 

Furthermore,  if  we  U8e  this  factor  score  matrix  we  can  then  postmulti- 
ply  the  transpose  of  the  standard  score  matrix  by  the  factor  score  matrix, 
and  this  will  yield  the  factor  loading  matrix  which  we  obtained  directly 
frem  the  previous  method  by  operating  on  a  minor  product  moment  of  the 
standardized  score  matrix.  It  can  readily  be  seen  from  the  definition  of 
the  basic  structure  that  this  must  be  the  case,  because  if  we  premultiply 
a  matrix  by  the  transpose  of  its  left  orthonormal,  we  must  by  definition 


have  the  right  orthonorawl  preaultipUsd  by  the  basic  diagonal.  Conversely, 
If  w#  premultiply  th#  transpose  of  euoh  •  data  matrix  by  Its  right  ortho¬ 
normal  and  than  pramultiply  again  by  th#  invars*  of  its  basis  diagonal,  v# 
must  gat  th*  laft  orthonormal* 

Zt  must  ba  pointad  out,  hovavar,  that  thasa  reciprocal  relationships 
hold  only  If  th*  basis  structure  analysis  is  parformad  without  altarlng  th# 
diagonal  alamants  of  tha  product  moment  matrix,  whathar  this  is  major  or 
minor.  The  oomaunalitias  issua  la  vary  much  a  part  of  this  problem.  Zt 
should  ba  emphasised  that  th*  definition  of  oommunalitlas  has  not  bean  mad* 
sufficiently  mathematical  so  that  on*  can  opacify  tha  relationship  involved 
in  these  reciprocal  types  of  solutions  if  ecmmunalitlas  rather  than  unity 
are  used  in  tha  diagonals  of  th*  correlation  matrix.  The  various  methods  of 
approximating  the  communallties  will  lnfluenc*  th*  kinds  of  relationships  ob¬ 
tained.  Since  any  mathematical  formulation  of  the  communal Ity  modal  is  ex¬ 
tremely  complex,  involving  complicated  nonlinear  relationships,  we  muet  con¬ 
clude  that  the  atudiea  which  have  been  done  to  compare  the  result!  of  so- 
called  obverse  factor  analysis  with  th#  conventional  methods  are  not  meaning¬ 
ful. 

As  a  matter  of  fact,  it  is  only  for  the  basic  structure  solution  that 
we  con  express  precisely  this  reciprocal  type  of  relationship.  From  a  theo¬ 
retical  point  of  view  therefore,  much  of  the  discussion  about  ths  factoring 
of  people  versus  factoring  of  tests,  or  the  obverse  types  of  factor  analysis, 
is  irrelevant.  However,  there  are  seme  practical  implications  involved  in 
deciding  whether  one  does  a  direct  factor  analysis  on  the  major  product  mom¬ 
ent  or  on  the  standardized  data  matrix. 

If,  for  example,  one  has  many  more  attributes  than  entitles,  what  we 
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have  conventionally  called  the  minor  product  moment  of  tble  date  matrix  li 
naturally  larger  than  what  we  have  called  the  major  produo t  moment*  This  la 
olear  if  we  regard  the  natural  order  of  the  data  matrix  ae  having  rove  for 
entitle#  and  attribute!  for  columns,  We  define  the  minor  produot  moment  aa 
the  natural  order  premultlplled  by  lta  transpose,  and  the  major  produot  mom* 
ent  aa  the  natural  order  poatmultlplled  by  lta  tranapoae.  Then  the  order  of 
the  minor  produot  moment  will  be  the  number  of  attrlbutee  and  the  order  of 
the  major  produot  moment  the  number  of  entitiea. 

If,  for  example,  we  have  given  a  personality  inventory  of,  say,  250 
items  to  a  group  of  100  persons,  and  we  wish  to  have  a  factor  analysis  of 
the  individual  lteme  In  tha  inventory,  the  conventional  procedure  would  be 
to  get  the  interoorrelatlona  of  these  lteme  and  to  do  a  factor  analysis  by 
one  of  the  methods  outlined  in  prevloue  chapters,  This,  of  course,  would  be 
a  250  x  250  matrix.  This  is  a  large  matrix  for  any  of  the  methode.  Zte 
analysis  would  be  prohibitive  with  desk  calculators  and  quits  expensive  with 
electronic  computer*.  On  the  other  hand,  if  we  take  the  product  of  the  data 
matrix  postaultlpllad  by  its  transpose,  we  have  a  100th  order  matrix  which 
can  be  factor  analyzed  in  perhaps  one  fifth  of  the  time  it  takes  to  factor 
analyze  one  which  has  an  order  of  250. 

We  shall  see,  therefore,  how  we  may  proceed  computationally  with  a  data 
matrix  having  many  more  variables  than  entitles.  We  shall  assume  that  the 
matrix  is  normalized  by  columns  so  that  we  have  moans  of  0  and  standard  de¬ 
viations  of  unity.  If  we  took  the  product  of  this  matrix  premultiplied  by 
its  transpose,  and  then  divided  by  the  number  of  cases,  ve  would  have  pre¬ 
cisely  the  intercorrelation  matrix  of  the  items. 
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On  the  other  hand,  if  we  took  the  product  of  the  a  tender'll  led  dete 
matrix  postmultlplled  by  ite  transpose,  we  would  not  heve  e  oorreletlon  matrix. 
Nevertheless,  from  auoh  e  product  we  may  derive  e  factor  loading  matrix  by  one 
of  the  baeic  atruoture  or  principal  axia  methods.  This  procedure  we  ahall 
indicate  in  the  next  section. 

14.4  Obverse  Paotor  Solution  with  Standard  Metric 
14.4.1  Computational  Equations 
14.1,1a  Definition  of  Notation 

X  is  the  N  x  n  matrix  of  raw  measurea. 

M  is  the  vector  of  means. 

2 

Dg  is  the  diagonal  matrix  of  variances. 

0  is  tho  major  produot  moment  of  the  standard  score  matrix. 

P  is  the  N  x  ra  matrix  of  factor  scores. 

Q  6^  is  the  n  x  m  matrix  of  factor  loadings. 


14. 4. lb  The  Equations 


M 


X'  1 
N 


(14.4.1) 

(14.4.2) 

(14.4.3) 


d  -  D^2 


(14.4.4) 
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We  then  calculate  the  elements  of  ths  diagonal  matrix,  aa  abovn  In  Eq. 
(14,4,J).  Thia  la  obtalnad  by  constructing  a  diagonal  natrix  of  tha  elements 
caloulatad  in  tha  vector  of  Eq.  ( 14,4,2),  and  subtracting  from  It  a  diagonal 
natrix  oonaiatlng  of  tha  squares  of  tha  elements  caloulatad  In  Eq.  (14,4,1), 
Zt  can  rondily  ba  ah  own  that  thia  la  a  diagonal  natrix  whose  diagonal  ala- 
manta  ora  tha  varlanoaa  of  tha  variablaa  in  tha  raw  acorn  data  matrix  X. 

Next  wo  indioata  tha  alananta  in  a  diagonal  natrix  by  Eq.  (14.1.4). 

Kara  wa  taka  tha  invaraa  of  tha  diagonal  natrix  on  tha  laft  of  Eq.  (14.4.3), 

Wa  naxt  premultiply  tha  oolumn  vector  caloulatad  in  Eq.  (14,4.1)  by  tha 
diagonal  matrix  calculated  in  Eq.  (l4,4,4)  to  get  tha  veotor  (J  Indicated  in 
Eq.  (14.4.5). 

Now  we  get  a  vector  V,  as  indicated  in  Eq.  (14.4.6).  Thia  la  tha  raw 
ecore  data  natrix  poatreultiplied  by  the  vector  U  calculated  in  Eq.  (14.4.5). 

We  then  calculate  a  scalar  quantity  a,  as  indicated  in  Eq.  (14.4.7). 

This  is  the  minor  product  moment  of  the  veators  calculated  in  Eqs.  (14.4.1) 
and  (14.4.5). 

Next  we  calculate  the  vector  W  as  in  Eq.  (14.4.8).  This  is  obtained  by 
subtracting  from  each  element  of  V  calculated  in  Eq.  (14.4.6)  one  half  tha 
scalar  a  calculated  in  Eq.  (14.4.7). 

Next  we  calculate  a  vector  Y^  beginning  with  k  -  1,  aa  in  Eq.  (14.4.9), 
Thia  vector  is  obtained  by  poatmultlplying  the  kth  row  of  the  X  raw  data 
matrix  by  the  diagonal  matrix  calculated  in  Eq.  (14,4.4). 

This  vector  is  then  used  to  solve  in  turn  for  the  elements  of  a  matrix 
Q,  which  is  tha  major  product  moment  of  the  raw  score  matrix.  As  we  recall, 
in  this  case  it  is  smaller  than  the  minor  product  moment.  Eq,  ( 14.4.10) 
shows  how  we  calculate  the  elements  for  the  kth  row  and  the  Jth  column.  The 


Y'  voctor  calculated  In  Eq.  ( 14.4*9)  i»  postmultipliad  by  the  Jth  row  of 
the  £  matrix  In  column  form,  and  from  thta  minor  produot  art  oubtraatad  tha 
kth  and  tha  ^th  elements  of  tha  W  vaator  of  Eq.  (14.4.8) .  It  la  not  neoee- 
aary  to  calculate  tha  acalar  quantities  of  Eq*  (14,4,10)  for  all  valuaa  of 
Wo  naad  calculate  them  only  for  valuaa  of  £  equal  to  or  greater  than  k» 
Thla  gives  ua  tha  alamanta  in  and  above  tha  diagonal  of  tha  0  matrix  indi¬ 
cated  In  Eq»  (14,4,11). 

Eq.  (14,4.11)  ahowa  tha  major  produot  moment  of  the  standardized  aoora 
matrix  ao  a  function  of  tha  baalc  diagonal  and  baalo  orthonormala.  To  this 
matrix  wa  now  apply  one  of  tha  principal  axis  oolutlona  indicated  In  pre¬ 
vious  chapters.  This  nay  be  carried  to  any  number  of  factors  desired,  ac¬ 
cording  to  how  much  of  the  variance  we  want  to  account  for,  or  what  other 
criteria  we  may  have  for  otopping  the  factoring. 

The  factor  loading  matrix  a  is  indicated  in  Eq.  (14.4,12),  Here  we 
see  on  the  right  hand  aide  that  first  we  postmultiply  the  transpose  of  the 
raw  score  matrix  by  the  P  matrix  calculated  from  Eq,  (14.4,11).  This,  it 
should  be  recognized,  is  precisely  the  principal  axis  factor  score  matrix 
for  the  normalized  score  matrix.  That  is,  Eq,  (14,4.11)  gives  us  the  pro¬ 
duct  moment  matrix  we  would  have  obtained  if  we  bad  normalized  the  X  matrix 
first  by  columns  and  then  poatmultiplied  this  normalized  matrix  by  its  trano 
pose. 

The  next  step  in  the  calculation  of  the  a  matrix,  as  indicated  in  Eq. 
(lU.4,12),  is  to  premultiply  tho  product  in  parentheses  by  the  square  root 
of  the  diagonal  matrix  calculated  in  Eq.  (14.4,4). 

It  should  be  observed  that  the  major  saving  in  computations  is  achieved 
when  the  number  of  variables  is  much  larger  than  the  number  of  attributes. 
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Actually,  ti  can  be  seen,  the  steps  involved  In  Eqs,  (14,4.1)  through  (14,4,10) 
art  not.  In  general,  more  laborious  than  the  calculation  of  tha  correlation 
matrix  In  which  tha  minor  product  moment  of  tha  standard  scars  matrix  la  in¬ 
volved*  There  is,  however,  an  additional  multiplication  indicated  in  Eq. 
(14.4,18)  in  whioh  the  factor  saore  matrix  is  poatmultiplied  into  the  trans¬ 
pose  of  tha  raw  score  data  matrix,  The  computations  for  this  operation  ordin¬ 
arily  would  not  be  great  compared  with  the  iterative  procedures  Involved  in 
the  solution  for  the  baslo  orthonormal  and  tha  basic  diagonals  of  a  very 
large  correlation  matrix. 

14,4.3  Numerical  Example,  We  illustrate  the  method  with  the  same  data 
matrix  uoed  in  Chapter  12,  even  though  it  is  a  vertical  matrix,  so  that  we 
may  compare  the  results  with  those  obtained  in  Chapter  18,  Seotlon  4* 

Table  lb, 4,1  gives  the  major  product  moment  of  the  standardised  data 
matrix.  The  number  108.0  at  the  lower  left  of  the  table  is  the  sum  of  the 
diagonal  elements.  This  ohould  be  equal  to  the  produot  of  the  orders  of 
the  matrix.  This  is  18  x  9  ■  108  and  serves  aa  a  check  on  the  computations , 

Table  14.4.2  gives  the  normalized  factor  score  matrix  for  the  first 
three  factors.  The  rows  of  this  table  are  proportional  to  the  columns  of 
Table  12,4.8.  The  proportionality  factor  is/TT*  or  /la  . 

The  first  row  of  Table  14,4,3  gives  the  first  three  baslo  diagonals  of 
the  correlation  matrix  corresponding  to  the  data  matrix.  These  results  may 
be  seen  to  agree  closely  with  those  of  basic  structure  solutions  for  the 
some  correlation  matrix  in  previous  chapters.  The  second  row  gives  the 
number  of  iterations  for  eaoh  factor.  The  body  of  the  table  gives  the  first 
three  principal  axis  factor  loading  vectors.  These  also  agree  closely  with 
those  solved  for  in  previous  chapters, 


Table  14.4.1  -  Major  Product  Mcoent  Matrix  of  Standardized  Score  Matrix 
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14 Mathematical  Pi-oof 

We  give  below  the  proof  that  the  computational  outline  above  doee  yield 
the  conventional  eolution  for  the  principal  axis  factor  loading  matrix  given 
in  previoue  chapter a, 

Given  the  raw  ecore  matrix  X,  let 


where  X*^'  means  a  matrix  of  the  squared  elements  of  X. 


(14.5.1) 

(14.5.2) 

(14.5.3) 


d 


(14.5.4) 


z 


LiLl  y  A 
-ir*iXd 


(14.5.5) 


Fran  Eq.  (14.5,5) 

*  *'  -  F  I  -  tp'Ix  d  X'  r  I  -  irH  (14.5.6) 

L  J  kt  mi 

Frcm  Eq.  (14.5.6) 

.  . .  1  1'  Xd  X'  X  d  X'  1  I'.l  1’  X  4  X'  1  1' 

2  1  “  X  d  X - R - - S -  +  - J3 - 

(14.5.7) 


Fi*cm  Eqs,  (l4.5«l)  and  (l4.5»7) 

z  z'  «  X  d  X'  •  1  M'  d  X'  •  X  d  M  1'  +  1  M'  4  M  l1  (l4.5.8) 


t 
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Ut 


U  -  d  M 


Substituting  Bq.  (14.5,9)  In  Eq,  (14,5,8) 


««'  »  X  d  X'  -  1  U'  X'  -  X  U  1'  +  1  U'  H  1' 


Lot 


V  -  XU 
a  m  u'  M 


} 


From  Eq.  (14.5.11)  in  Eq.  (14,5.10) 

*  ■  X  d  X'  •  1  V'  •  V  1'  +  o  1  1' 


Let 


W  -  V-Jai 

From  Eq.  (14.5.13)  in  Eq.  (14.5.12) 


*  t*  -  X  d  X'  •  1  «'  .  »  1' 


Let 


Q  >  tt' 


Frcra  Eqs.  (14.5.14)  and  (14,5.15) 


°1J  "  Xi.  d  XJ.  "  Mi  ’  WJ 


(14.5.9) 


(14.5.10) 


(14.5.11) 


(14.5.12) 


(14.5.13) 


(14.5.14) 


(14.5.15) 


(14.5.16) 
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Given  the  baeio  struoture  forms 
0  -  P6P' 
l  -  P  8^  ft' 

From  Eqs.  (14,5,5)  and  (14.5.18) 

ft  6*  P'  -  d*  X#  I  I  -  1  1' 

L  T. 

From  Eq.  (14.5.19) 

ft  6*  -  X'  P  •  X'  1  1'  P 

From  Eq.  (14.5.19) 

P'  1  -  0 

From  Eq.  (14.5.21)  in  Eq.  (14,5.20) 
ft  6^  «  d$  (X'  P) 


(14.5.17) 

(14.5.18) 

(14.5.19) 

(14.5.20) 

(14.5.21) 

(14.5.22) 


CHAPTER  15 


TUB  PRORLiH  OP  CCAUNO 

In  Chaptsr  13  we  considered  the  problem  of  origin  or  tarn  point  no  it 
affect*  factor  analytic  aolution*.  We  sow  that  wa  may  work  with  raw  acora 
matricaa,  deviation  score  matrices,  or  a  number  of  ccmbtnations  of  these  two 
methods,  We  learned  that  we  may  factor  right  centered  and  left  centered 
matrices  or  botb--that  is,  matrices  which  have  means  subtracted  from  the  col¬ 
umns,  those  which  have  means  subtracted  from  the  rows,  and  those  which  have 
means  subtracted  frem  both  rows  and  columns. 

We  saw  also  that  we  may  conduct  factor  analytic  solutions  based  on  pro¬ 
cedures  which  may  aubtraot  or  add  constants  other  than  means  to  the  rows  and / 
or  columns,  and  that  these  solutions  vary  according  to  the  specific  patterns 
for  adding  constants  to  rows  or  columns.  We  Indicated  that  there  may  be 
rational  procedural!  for  determining  what  constants  should  be  added,  as  in 
cases  where  natural  zero  points  are  available,  Wc  showed  in  Chapters  U  and 
13  that  the  unit  for  scaling  one  attribute  may  not  be  comparable  to  that  for 
scaling  another,  and  that  therefore  rationales  for  making  such  scales  compar¬ 
able  may  be  of  interest. 

15.1  Kinds  of  Scaling 

It  is  clear  that  if  we  have  a  large  set  of  measures,  such  as  physiologi¬ 
cal,  psychological,  or  other  types,  these  may  vary  widely  in  comparability. 
For  example,  height  may  be  measured  in  feet  and  a  teat  score  may  be  measured 
in  terms  of  items  correct  on  a  500-item  test. 

The  conventional  procedure,  as  indicated,  hac  been  to  reduce  all  these 
to  standard  deviation  measures.  We  have  in  general  three  types  of  possibili¬ 
ties  for  scaling.  We  may  scale  by  entities,  by  attributes,  or  by  both.  In 
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any  aaaa  it  ia  wall  known  that  a  particular  factor  analytic  solution  will  de¬ 
pend  on  the  scaling  procedure.  This  is  because  the  basic  structure  of  a  data 
matrix  is  altered  in  a  very  complicated  fashion  if  the  data  matrix  is  multi¬ 
plied  by  a  diagonal  matrix, 

19.1.1  Scaling  by  Attributes,  We  have  already  considered  in  sane  detail 
the  reasons  why  the  problem  of  scaling  by  attributes  arises.  This,  ef  course, 
means  that  we  postmultlply  a  data  matrix  by  a  diagonal  matrix.  In  the  case 

of  a  scaling  procedure  which  reduces  all  variables  to  unit  standard  devi¬ 
ations,  ve  simply  postmultlply  the  data  matrix  by  the  inverse  of  a  diagonal 
matrix  whose  elements  are  standard  deviations  of  the  variables  in  whatever 
units  they  are  measured.  This  has  been  the  traditional  method  of  aceling 
for  factor  analytia  solutions. 

It  should  be  noted,  however,  that  euch  a  scaling  procedure  is  specific 
to  the  particular  sample  to  which  it  is  applied.  If  one  used  such  e  scaling 
procedure  on  a  particular  sample  and  applied  the  earns  diagonal  scaling  matrix 
to  a  data  matrix  obtained  from  some  other  sample,  he  would  not  expect  that 
that  variances  for  the  new  sample  would  be  unity.  In  general  these  would 
depart  from  unity  to  a  greater  or  lesser  degree.  The  fact  that  the  normaliz¬ 
ing  scaling  procedure  is  specific  to  a  particular  sample  casts  doubts  on  ltn 
validity. 

15.1.2  Scaling  by  Entities.  The  problem  of  scaling  by  entities  has 
not  received  much  attention,  or  perhaps  even  been  regarded  as  a  relevant 
problem  in  factor  analysis  procedures.  Certainly  the  question  of  origin  by 
entities  is  of  both  theoretical  and  practical  importance  in  the  analysis  of 
behavioral  Bcience  data.  We  have  seen  how  it  arises  ii.  the  case  of  ipsative 
type  measures  in  personality  scales.  It  also  arises  in  the  case  differential 
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prediction  problems.  This  ws  have  discussed  in  Chapter  l).  Obviously,  the 
shifting  of  origins  by  antltlss  or  rows  of  the  natural  order  data  matrix  has 
Its  analog  In  soallng  by  entitles.  This  Implies  formally,  of  oourso,  a  multi¬ 
plication  on  the  left  of  the  natural  order  data  matrix  by  a  diagonal  matrix. 
The  question  of  what  sort  of  diagonal  matrix  Is  appropriate  for  a  given  prob¬ 
lem  depends  on  the  particular  Interest  of  the  Investigator. 

One  may  assume,  for  example,  that  certain  of  the  entitles  should  receive 
less  weight  than  others  In  a  factor  analytic  solution.  It  may  be  that  because 
of  biased  sample  selection  it  might  be  desirable  to  weight  certain  of  the  en¬ 
titles  more  and  others  less,  to  overcome  the  effects  of  bias.  For  example,  If 
one  had  selected  a  group  of  individuals  so  that  in  general  the  higher  scoring 
Individuals  were  believed  to  be  less  well  represented,  compared  to  seme  target 
population,  than  those  in  the  lower  group,  then  the  former  might  be  given 
higher  weightings.  Therefore  the  diagonal  elements  of  the  left  scaling  matrix 
would  be  larger  for  the  higher  group  than  for  the  lower. 

19.1.3  Scaling  by  Entries  and  Attributes.  It  is  now  obvious  that  a 
more  general  view  of  the  scaling  problem  for  a  data  matrix  would  involve  scal¬ 
ing  by  both  entities  and  attributes.  Here  the  formal  model  includes  both  pre- 
and  postmultiplicatlon  of  the  data  matrix  by  diagonal  matrices.  One  may  make 
a  rather  basic  distinction,  however,  between  the  types  of  left  and  right  scal¬ 
ing  matrices  which  might  be  considered.  In  the  case  of  right  diagonal  scal¬ 
ing  matrices  one  might  well  have  both  positive  and  negative  elements  In  the 
scaling  diagonal.  For  example,  if  one  wishes  to  reverse  the  scale  for  cer¬ 
tain  personality  item  variables  in  a  data  matrix  to  change  a  negative  stated 
statement  to  a  positive  form,  then  presumably  one  would  use  &  negative  element. 
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However,  in  the  otii  of  the  left  diagonal  multiplier,  it  it  difficult  to  •••  f 

by  what  rational#  on#  night  wloh  to  giv#  a  n#gativ#  weight  to  a  particular  #n-  j 

tlty,  In  general,  any  l# ft  diagonal  multiplier  for  the  data  matrix  would  al-  j 

moat  aertninly  hav#  all  poaitiv#  #lem#nt#*  j 

Since  currently  ther#  i#  very  little  available  on  the  rationale  or  teoh-  j 

nique  of  aoaling  data  matrioea  by  entities,  and  since  no  experinental  or  ocm- 
putational  work  ha#  been  carried  out,  we  ahall  not  puraue  the  natter  further* 

We  ahall  direct  our  attention  to  problem#  Involved  in  the  coaling  of  data 
metric##  by  attribute#* 

15.2  Scaling  by  Attribute# 

15.2*1  The  General  Problem  of  Scale*  We  have  already  diacuaaed  a  number 
of  conaideratlona  involved  In  the  ecollng  of  a  data  matrix  by  attrlbutea,  or 
the  poatmultlpllcation  of  the  natural  order  data  matrix  by  a  diagonal  matrix. 

We  have  pointed  out  that  factor  analytic  result#  may  vary  considerably  accord¬ 
ing  to  what  scaling  procedures  ore  used.  We  have  indicated  that  the  Gordian 
knot  la  usually  cut  by  using  standardized  measures,  nevertheless,  it  would 
seem  desirable  to  have  factor  analytic  procedures  which  are  relatively  inde¬ 
pendent  of  the  scale.  We  shall  now  consider  in  more  detail  some  of  the  cri¬ 
teria  which  suggest  themselves  In  establishing  scaling  procedures. 

j 

15.2.2  Criteria  for  Scaling.  One  of  the  most  obvious  rationales  for 
scaling  has  been  previously  suggestod--namely,  that  of  using  natural  units  j 

when  they  are  available.  We  have  indicated  that  In  the  case  of  the  three  j 

category  matrix  In  which  one  of  the  slabs  Is  an  entity-occaBion  matrix,  the  I 

i 

occasions  regarded  as  attributes  may  already  be  In  relative  natural  units.  j 

For  example,  the  measures  of  a  set  of  entities  on  typewriting  scores  for  sue-  j 

j 

cesslve  weeks  are  comparable  both  with  respect  to  origin  and  scale.  The  j 

1 

1 
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variation  in  scores  frets  on*  week  to  tha  next  for  this  group  of  entitles  la 
not  some  artifact  of  tha  mathod  of  evaluation,  but  may  ba  of  oonaldarabla 
lntaraat  in  Itaalf.  Unfortunately,  however,  eueh  natural  unlta  are  not  avail* 
able  for  much  of  tha  data  to  ba  subjected  to  factor  analytic  aolutlona, 

Wa  have  already  mentioned  the  poaalbility  that  tha  factor  analytic  pro* 
cedure  may  ba  auch  that  tha  solution  la  relatively  Independent  of  any  acal* 
ing  diagonal  matrix.  Wa  shall  now  consider  sene  of  theae  solutions. 

15*3  The  Communallty  Problem  and  Scaling 

Throughout  tha  previous  chapters  dealing  with  specific  methods  of  factor 
analysis  wa  have  referred  to  the  communallty  problem  without  being  very  speci¬ 
fic  os  to  what  is  meant  by  the  term  communallty.  True,  It  is  defined  both 
theoretically  and  computationally  in  texts  on  factor  analysis.  In  general 
It  is  said  to  be  that  part  of  the  variance  of  a  system  which  is  common  to  two 
or  more  variables.  This  is  not  a  very  precise  definition. 

The  communallty  problem  has  also  been  discussed  from  a  computational 
point  of  view.  Here  tha  problem  is  to  determine  the  diagonal  elements  of  a 
correlation  or  covariance  matrix  so  as  to  reduce  the  rank  of  the  matrix.  To 
solve  this  problem  wa  must  decide  whether  we  want  to  reduce  the  rank  of  an 
experimental  correlation  matrix  precisely,  or  whether  we  want  to  reduce  the 
rank  of  another  matrix  which  resembles  the  original  correlation  matrix  as 
closely  as  possible  according  to  some  criterion.  But  in  the  latter  case  ve 
have  to  define  "as  closely  as  possible," 

The  traditional  approach  has  used  approximations  to  the  diagonal  values 
which  enable  one  to  account  more  accurately  for  the  offdlagonal  elements 
with  a  smaller  number  of  factors  than  is  accounted  for  by  using  unity  in  the 
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diagonal**  W«  Hava  aten  that  for  corraiation  and  ra*ldual  matrices  one  mat hod 
1*  to  aubatituta  tha  largaat  abaoluta  offdlagonal  alamant  in  a  column  for  tha 
diagonal  alamant. 

Thaaa  procedures,  however,  do  not  provida  praoiea  or  rlgorou*  dafinitiona 
of  ooramunalitiee,  nor  do  thoy  indicata  an  underlying  mathematical  modal  for 
thoir  determination.  They  art  merely  verbal  and  arithmetic  procaduraa  with 
little  reference  to  their  interpretation  or  aignifioanoe  for  tha  data  matrix 
from  which  the  correlation  matrix  i*  derived.  We  have  indicated  in  Chapter 
4  that  one  ohould  be  able  to  account  completely  for  the  reaulta  of  a  factor 
analyst a  in  terra*  of  tha  original  data  matrix  rather  than  in  term*  of  tha 
correlation  matrix. 

Perhaps  sane  of  the  best  work  on  the  camunolity  problem  has  bean  done 
by  Outtmon  (1958),  Harris  (1962),  and  earlier  by  Lawley  (1940)  and  Rao  (1955)* 
In  general  these  inveetlgators  have  been  aware  of  the  relationship  of  the 
commonality  problem  to  the  scaling  problem.  Implicit  in  their  work  is  the 
notion  that  the  commonality  problem  ie  really  a  scaling  problem. 

We  shall  therefore  consider  certain  types  of  factor  analytic  solotions 
which  have  techniques  for  solving  the  sealing  problem  built  into  them.  These 
are,  in  effect,  methods  which  are  independent  of  scale  or  in  which  the  scal¬ 
ing  diagonal  cancels  out  in  the  mathematical  model. 

15.4  Characteristics  of  the  Methods 

All  of  the  models  to  be  considered  have  certain  characteristics  in  ccnmon. 
First,  they  are  all  special  cases  of  the  rank  reduction  method;  second,  they 
are  least  square  or  basla  structure  solutions)  third,  each  solves  for  a  scal¬ 
ing  diagonal  matrix  |  and  fourth,  they  are  what  may  be  called  doubly  iterative 


solutions. 
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15.4.1  OpscUl  Cass  of  Rank  Reduction  Method,  gaoh  of  tha  msthods  to  bs 
a  on  oi  do  rod  la  a  special  oaaa  of  tha  rank  reduction  formula  in  that  tha  ramoval 
of  aaoh  faotor  raaulta  In  a  raaldual  matrix  which  la  of  rank  ona  laaa  than  tha 
pravioua  roaidual  matrix.  Furthermore,  each  approximation  to  a  faotor  matrix 
la  a  rank  reduction  aolution, 

15.4.2  Least  Square  Basic  Structure  Solutions*  All  of  the  aolutlona 
we  ahall  consider  are  baalo  structure  or  least  square  solutions,  with  raspect 
to  the  scaled  matrices*  This  point  will  not  be  elaborated  here,  as  it  will 
be  clarified  in  the  computational  procedure  and  the  mathematical  proofs* 

15.4*3  Solution  for  Scaling  Diagonals.  Aa  implied  by  the  previous  dls> 
cues  ion,  all  of  the  solutions  to  be  considered  solve  for  a  scaling  diagonal 
matrix*  It  is  to  be  observed,  however,  that  the  procedure  used  to  solve  for 
this  scaling  diagonal  matrix  varies  considerably  from  one  method  to  another. 

In  two  of  the  models,  a  single  scaling  diagonal  matrix  is  solved  for.  In  the 
other  model,  the  scaling  diagonal  matrix  is  different  for  each  factor  vector. 
In  thia  latter  model,  a  scaling  diagonal  matrix  is  found  for  each  residual 
matrix.  The  solution,  however,  is  again  Independent  of  any  particular  scale 
that  we  start  with,  such  as  in  the  normalized  data  matrix. 

15.4,4  Doubly  Iterative  Type  Solutions,  All  of  the  methods  to  bo  con¬ 
sidered  might  be  regarded  as  doubly  iterative,  because  not  only  does  one 
iterate  to  the  solution  for  a  factor  vector  or  matrix,  but  one  also  iterates 
to  the  scaling  diagonal.  This  is  because  the  scaling  diagonal  matrix  is  it¬ 
self  a  function  of  the  factor  loading  vectors,  which  in  turn  are  a  function 
of  the  scaling  diagonal  matrix.  One  of  the  consequences  is  that  the  solution 
may  be  very  laborious  and  costly.  Even  with  high  speed  computers,  the  cost 
and  time  may  be  excessive  if  the  number  of  variables  or  attributes  is  large. 
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15.5  Kind*  of  flolutlon* 

W#  shall  consider  six  different  kinds  of  solutions  which  art  independent 
of  seals.  Thtss  nay  bs  divided  Into  two  general  classes. 

The  first  of  these  classes  we  call  the  speoiflclty  type  solutions,  the 
model  on  whloh  these  solutions  ore  based  was  first  proposed  by  Lawley  (1940) 
and  later  developed  In  essentially  the  same  form,  but  from  a  somewhat  different 
set  of  hypotheses  and  assumptions,  by  Rao  (1955)* 

The  second  class  of  solutions  may  be  oalled  the  ccmnumllty  type  solu¬ 
tions,  These  are  baaed  on  a  general  model  developed  by  Horst.  Beginning  In 
1950,  the  method  was  presented  in  leature  notes  at  the  University  of  Washing¬ 
ton  but  these  were  not  published.  More  recently,  Kaiser,  in  personal  com¬ 
munication  and  in  oonferenoe  presentations,  proposed  a  related  type  of  pro¬ 
cedures. 

Both  the  specificity  and  the  communality  types  of  solutions  may  be  di¬ 
vided  into  tnroe  different  variations.  The  first  of  these  we  shall  call  the 
successive  factor  method.  It  requires  the  solution  of  a  single  factor  vector 
at  a  time.  With  the  solution  for  each  factor  vector,  a  residual  matrix  is 
calculated  and  another  factor  vector  is  calculated  frera  the  residual  matrix. 
Thin  type  of  oolutlon  is  analogous  to  the  single  factor  residual  solution 
outlined  for  the  centroid  and  the  basic  structure  or  principal  axis  methods 
In  Chapters  5  and  7,  respectively.  With  the  solution  for  each  factor  one  ob¬ 
tains  a  scaling  diagonal  matrix  which  is  a  function  of  the  elements  of  the 
factor  vector  itself. 

The  second  type  of  solution  for  both  the  specificity  and  the  communal¬ 
ity  models  may  be  called  the  factor  matrix  solution.  Here  one  mokes  some  as¬ 
sumption  as  to  the  number  of  factors  in  the  set  and  begins  with  some  crude 
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approximation  matrix  of  thia  ordar  for  tha  factor  matrix*  Dy  a  preoaaa  of 
auooaasiva  itarationa  ona  converges  to  tha  faotor  loading  matrix, and  to  tha 
aoaling  diagonal  whioh  ia  a  function  of  all  of  tha  faator  vaatora* 

Theaa  two  typaa  of  aolutiona  do  not  in  ganaral  give  tha  aame  reaulta 
for  a  apecifled  number  of  faotora.  The  aoaling  variea  from  one  faotor  veotor 
aolutlon  to  the  next  in  the  reaidual  method,  whareaa  it  oonvargaa  to  a  aingla 
diagonal  matrix  whan  ona  iterataa  to  all  tha  dealred  faotor  vaatora  simul¬ 
taneously. 

There  ia  a  variation  of  tha  faator  matrix  method  which  ccmbinaa  tha 
faaturea  of  both  of  tha  otharo.  Thia  we  ahall  call  the  progreaaive  faotor 
matrix  method.  Hare  one  begina  with  the  aolutlon  for  a  aingla  faotor  and 
then  successively  adds  factors  to  the  factor  loading  matrix  without  ever 
computing  reaidual  matrices. 

15,6  Specificity  Successive  Factor  Solution 

We  ahall  first  take  up  the  specificity  scaling  method  for  each  of  the 
three  variations:  the  successive  factor,  the  matrix,  and  the  progressive 
matrix  aolutiona.  First  we  shall  consider  the  successive  factor  type  solu¬ 
tion, 

15,6.1  Characteristics  of  the  Solution.  This  method  is  characterized 
by  the  fact  that  only  one  factor  at  a  time  is  solved  for,  after  which  a  resi¬ 
dual  matrix  is  calculated,  the  next  factor  loading  vector  is  calculated  fran 
the  residual,  and  so  on. 

All  of  the  specificity  types  of  solutions  are  similar  with  respect  to 
tho  scaling  unit  solved  for.  The  scaling  unit  is  such  that  the  variance  of 
the  rescaled  variables  is  proportional  to  the  reciprocal  square  root  of  their 
residual  variances.  That  is,  we  define  these  residual  variances  as  the 
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original  variance  of  the  variables  lass  tha  amount  of  variance  aooeuntad  for 
by  a  given  factor  or  sat  of  factors,  depending  on  which  type  of  solution  is 
used.  In  tha  successive  factor  solution,  tha  first  scaling  constant  for  eaoh 
variable  is  proportional  to  the  reciprocal  square  root  of  tha  difference  be¬ 
tween  the  original  variance  of  the  variables  and  the  variance  accounted  for 
by  the  first  factor*  The  first  factor  is  then  removed  from  the  oovarianoe 
matrix  to  yield  a  residual  matrix*  This  residual  matrix  is  then  scaled  in 
the  same  manner  as  are  subsequent  residual  matrices* 

15*6.2  Computational  Equations 
15.6.2a  Definition  of  Notation 

C  is  a  correlation  or  covariance  matrix. 

Dq  is  a  diagonal  matrix  of  the  diagonals  of  C. 

.a  is  an  arbitrary  vector. 

D  a  is  a  diagonal  matrix  whose  elements  are  from  the  vector  ^a. 

,?  is  a  tolerance  limit. 

15.6.2b  The  Equations 


Qa  -  C  1  (!'  C  1)^ 


<DC 
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(15.6.1) 

(15.6.2) 

(15.6.3) 


(15.6.4) 


79 


,  ui  t; 

ow  ou 


ia  "  oWao 


i°2  -  <DC  -"J/ 


iu  -  1D  i* 


iw  -  ciu-ia 


1  777* 


i+la  -  lMai 


ai+l“ai  -  ip 
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(15.6.5) 

(15.6.6) 
(15.6.7) 
(15.6.6) 

(15.6.9) 

(15.6.10) 

(15.6.11) 

(15.6.12) 

(15.6.13) 


2C  -  C  -  a'a  (15.6.14) 

15*6.3  Computational  Instructions.  In  this  procedure,  as  In  all  of  the 
methods  In  this  section,  one  may  begin  with  either  a  correlation  matrix  or  a 
covariance  matrix  scaled  In  any  convenient  fashion.  Ordinarily  It  is  probab¬ 
ly  best  to  work  with  correlation  matrices.  These  are  familiar  to  most  invest! 
gators  and  are  convenient  from  the  point  of  view  of  number  of  digits  carried 


in  the  elements  of  the  matrix 
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All  of  the  diagonals  art  unity,  of  oourse,  in  the  oorralatton  matrix*  J 

■-  .  .  .  '  .......  •'  '  f 

Zn  any  oasa,  for  all  of  tha  mathoda  to  ba  disousaad,  unity  is  usad  in  tha  j 

diagonals  of  oorralation  matriaas,  and  varianoaa  ara  usad  in  tha  diagonals 
of  covarianca  matrloaa, 

Ws  begin  with  sens  arbitrary  approximation  to  a  first  faotor  loading 
vactor*  This  oan  ba,  for  axampla,  a  first  eantroid  vector,  as  indicated  in 
Eq*  (15,6,1),  It  could  also  ba  a  principal  axis  faotor  loading  vector, 

Tha  noxt  stop  is  indicated  in  Eq,  (15.6,2),  Hare  one  gats  tha  differ¬ 
ence  between  the  diagonal  elements  of  tha  oovariance  or  correlation  matrix 
and  a  diagonal  made  up  of  the  squared  elements  of  tha  vector  in  Eq,  (15.6.1), 

This  io  indicated  on  the  right  hand  side  of  the  equation.  This  diagonal 
matrix  is  then  Inverted  to  give  tha  diagonal  matrix  on  the  left  of  the  equa¬ 
tion,  It  will  ba  recognised  that  tills  matrix  on  the  left  is  a  diagonal  matrix 
of  the  reciprocal  of  the  difference  between  two  diagonal  matrices,  the  first 
of  which  is  a  diagonal  matrix  of  variances, and  the  second' of  which  la  a  diagon¬ 
al  matrix  of  the  variances  accounted  for  by  the  first  approximation!  factor. 

The  next  step  is  indicated  in  Eq.  (15.6.5)*  Here  we  calculate  a  vector 
q{J  on  the  right  of  the  equation,  Zt  is  obtained  by  premultiplying  the  vector 
of  Eq,  (15.6.1)  by  the  dlagonul  matrix  of  Eq,  (15*6,2). 

Next  we  calculate  the  QW  vector  in  Eq,  (I5.6.U).  This,  as  shown  on  the 
right  of  the  equation,  is  obtained  by  postmultiplying  the  covariance  or  cor¬ 
relation  matrix  by  the  vector  calculated  in  Eq.  (15.6,3)  and  subtracting 
freo  the  product  the  vector  Qa  calculated  in  Eq.  (I5.6.I). 

Now  we  calculate  the  scalar  quantity  indicated  by  Eq,  (15,6.5).  Here 

J 

we  get  the  minor  product  of  tha  vectors  calculated  in  Eqs.  (15.6.3)  and  i 
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(15.6,4)  and  taka  tha  reciprocal  square  root  of  thta  product, 

lh»n  wa  gat  tha  flrat  rank  reduction  approximation  to  tha  first  faotor 
loading  vector,  as  indicated  in  Bq,  (15,6,6)  by  tha  vaotor  ja  on  tha  laft  of 
tha  aquation.  This  is  aaan  to  ba  tha  vaotor  gW  of  Rq,  (15,6,4)  multiplied 
by  tha  scalar  quantity  of  aQ  of  Eq,  (15,6,5), 

Eq,  (15,6.7)  gives  tha  1th  approximation  to  tha  matrix  aa  tha  inverse 
of  a  matrix  obtained  by  subtracting  from  tha  diagonal  of  tha  C  matrix  the  cor¬ 
responding  squared  elements  of  tha  current  approximation  to  the  faotor  load¬ 
ing  vector.  As  will  ba  seen,  therefore,  Bq,  (15.6,7)  gives  a  diagonal  matrix 
which  is  an  approximation  to  tha  inverse  of  the  diagonal  of  tha  residual 
matrix. 

The  general  equation  for  the  U  vector  Is  given  in  Eq,  (15,6.0),  This  is 
simply  the  current  approximation  to  the  factor  loading  vector  premultiplied 
by  the  diagonal  matrix  of  Eq,  (15.6,7). 

The  general  equation  for  the  W  vector  is  given  by  Eq.  (15.6.9).  Thio  is 
obtained  by  poatmultiplylng  the  correlation  matrix  by  the  U  vector  of  Eq. 
(15.6.8)  and  subtracting  from  the  product  the  previous  approximation  to  the 
factor  vector. 

The  ith  approximation  for  the  scalar  quantity  a  is  the  reciprocal  square 
root  of  the  minor  product  of  the  vectors  given  by  Eqs,  (15.6.0)  and  (15.6.9), 
as  indicated  on  the  right  hand  side  of  Eq,  (15.6.10). 

The  general  equation  for  the  i+1  approximation  to  the  first  factor  load¬ 
ing  vector  is  given  by  Eq.  (15.6.11).  This  is  the  W  vector  of  Eq.  (15.6,9) 
multiplied  by  the  scalar  of  Eq.  (15.6.10). 

To  determine  whether  we  have  gone  far  enough  in  our  approximation,  we 
can  compare  successive  approximations  to  the  a  vector  given  by  Eq.  (15.6,11). 
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However,  it  ia  probably  almplar  to  uaa  tha  oritarton  indicated  by  Eq,  (15,6,12), 
This  ia  tha  difference  batwaen  auoceaaiva  a  value*,  Thaaa  a  valuaa  should,  in 
general!  inoreaaa  in  magnitude  or  atabillze  ao  that  whan  the  P  value  indi¬ 
cated  by  Eq,  (15,6,12)  la  ouffloiently  email,  ve  nay  atop  tha  lteratlono 
for  tha  firat  factor  vector. 

Whan  tha  iteratione  are  auffioiantly  a lose,  we  may  regard  tha  l+l  ap¬ 
proximations  to  a  a*  tha  first  factor  loading  vector,  namely,  a  aa  given 
in  Eq.  (15.6.13). 

Next  ve  calculate  a  residual  matrix  gC  aa  Indicated  In  Eq,  (15,6.14), 

This  ia  obtained  by  subtracting  tha  major  product  moment  of  the  factor  load¬ 
ing  veotor  frets  the  covariance  or  correlation  matrix. 

We  now  proceed  through  the  same  sot  of  computation#  outlined  in  Eqe. 
(15.6,1)  through  (15.6.13),  except  that  these  are  performed  on  the  residual 
matrix  givon  by  the  left  side  of  Eq,  (15.6.14),  rather  than  on  the  original 
matrix. 

Each  suaceaeive  residual  matrix  is  calculated  aa  in  Eq,  (15.6.15).  Then 
the  routine  outlined  in  Eqs,  (15,6.1)  through  (15.6.14)  io  applied  to  each 
of  tha  residual  matrices.  The  criterion  of  when  to  stop  factoring  may  be 
one  of  those  ouggeated  in  previous  chapters, 

15.6.4  Numerical  Example.  A  numerical  example  of  the  method  is  given 
belov.  We  use  the  some  correlation  matrix  as  in  previous  chapters.  This  cor¬ 
relation  matrix  is  repeated  for  convenience  in  Table  I5.6.I.  The  arbitrary 
vector  for  each  of  the  four  factors  was  taken  as  the  unit  vector.  The  solu¬ 
tion  ia  doubtless  dependent  on  the  arbitrary  vectors,  and  currently  no  "best" 
method  ia  available  for  determining  these  vectors. 
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T he  first  row  of  Table  15,6,2  gives  the  number  of  iterations  for  each 
of  th*  first  four  factors.  Tbs  second  row  givts  ths  variance  accounted  for 
by  eoah  factor,  Ths  body  of  ths  tabls  gives  ths  first  four  faotor  loading 
vectors.  As  in  the  methods  of  previous  chapters,  only  ths  first  three  factors 
appear  "significant," 

It  is  interesting  to  note  that  ths  faotor  loading  vectors  bear  little 
resemblance  to  ths  principal  axis  factors  of  Chapters  8,  9*  sod  10.  As  a 
matter  of  fact,  they  resemble  more  olossly  the  fiators  given  by  the  group 
centroid  methods  of  Chapter  6,  It  is  not  clear,  however,  to  what  extent  the 
factors  might  change  if  vastly  more  iterations  were  taken, 

15<7  The  Specificity  Factor  Matrix  Solution 

15.7,1  Characteristics  of  the  Method.  In  this  method  the  residual 
variance  scaling  matrix  is  based  on  all  of  the  factors  to  be  solved  for, 
rather  than  on  a  single  factor  as  in  the  method  Just  outlined.  Therefore 
we  do  not  have  a  rescaling  after  each  factor  vector.  The  method  is  differ* 
ent  also  in  that,  instead  of  solving  for  a  single  factor  at  a  time  and  getting 
a  residual  matrix  for  each  cycle,  ve  start  with  a  rough  approximation  to  ths 
complote  factor  matrix  in  which  some  specified  number  of  factors  is  assumed. 

We  then  iterate  successively  to  the  factor  loading  matrix  and  to  the  scaling 
diagonal  whose  elements  are  the  reciprocal  square  roots  of  the  residual  vari¬ 
ances. 

15.7*2  Computational  Equations 
15*7*2a  Definition  of  Notation 

C  is  a  covariance  matrix. 

Dq  is  -the  diagonal  matrix  from  C. 


Table  15,6,1  -  The  Correlation  Matrix 


1,000 

0,029 

0,768 

0.108 

0,033 

0,108 

0,298 

0,309 

0.351 

0.029 

1.000 

0.779 

0.115 

0.061 

0,125 

0.323 

0,347 

0.369 

0,760 

0,775 

l.ooo 

O.272 

0,205 

0,236 

0.296 

0,271 

0,383 

0.108 

0,115 

0.272 

1,000 

0,636 

0.626 

0.249 

O.I83 

0.369 

0.033 

0.061 

0,205 

0,636 

1.000 

0.709 

0.138 

0.091 

0,254 

0.108 

0.125 

0.238 

0,626 

0.709 

1.000 

0.190 

0.103 

0.291 

0,298 

0.323 

0.296 

0.249 

0,138 

0.190 

1.000 

0.654 

0.527 

0.309 

0.347 

0.271 

0.183 

0.091 

0.103 

0.654 

1.000 

0,541 

0.351 

0.369 

0.383 

0.369 

0.254 

0.291 

0.527 

0.541 

1.000 

Table  15,6,2  -  Specificity  Successive  Factor  Method,  Number  of  Iterations, 
Variance  Accounted  for,  and  First  Four  Faotor  Vectors 

24  21  JO  JO 

2.9730  2.0250  1.1978  O.0898 

0.8910  -0.1076  -0.0480  -0.0116 
0.9067  -0.0867  -0.0182  -0.0654 
0.8572  0.0914  -0.0932  0.0874 
0.2151  0.7438  0.0475  0.2218 
0.1389  0.8266  -0.0821  -0.0500 
0.2025  0.7968  -o.o6eo  -0.0587 
0.39H  0.1770  0.6572  0.0118 
0.3957  0.1012  0.7303  *0.0627 
0.4539  0.2908  0.4558  0.1360 


£  la  an  arbitrary  factor  matrix  approximation  of  apaoifiad  width. 
!•  tha  1th  approximation  to  tha  factor  matrix. 

®  ■  mi  1*  tha  diagonal  matrix  of  .a. a', 

11 

jt  la  a  triangular  matrix. 

P  la  a  toloranco  limit. 

15.7.2b  Tha  Equation* 
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tr  (  t) 

(15.7.13) 

15.7-3  Computational  Instructions.  Zn  this  variation  of  th«  specifi¬ 
city  method  we  postulate  a  given  number  of  factors  and  begin  with  an  arbit¬ 
rary  factor  loading  matrix  Including  the  assumed  number  of  factors.  This  we 
may  obtain  from  the  methods  of  previous  chapters. 

We  first  calculate  a  diagonal  matrix  as  in  Eq.  (I5.7.I),  This  is  ob¬ 
tained  by  subtracting  from  the  diagonal  of  the  covariance  matrix  the  diagon¬ 
al  of  the  major  product  moment  of  the  arbitrary  factor  loading  matrix.  Then 
we  take  the  inverse  of  this  difference  matrix  as  indicated  on  the  right  of 
Eq.  (15.7.1). 

The  next  step  la  to  calculate  the  U  matrix,  as  indicated  in  Eq.  (15.7,2). 
Here  we  preraultiply  the  first  approximation  to  the  factor  loading  matrix  by 
the  diagonal  matrix  calculated  in  Eq.  (15.7.1). 

We  then  calculate  a  W  matrix,  as  In  Eq,  (15.7*3).  This  is  obtained  by 


postmultiplying  the  aovsrisncs  matrix  0  by  tha  (/  matrix  calculated  in  E q. 
(15.7,2)  and  subtracting  from  tha  product  tha  arbitrary  approximation  to  tha 
motor  matrix, 

Next  va  oaloulata  tha  matrix  0  in  Eq.  (15*7.4),  This  ia  tha  minor  pro- 
duot  of  tha  matrioaa  caloulatad  in  Eqa.  (15*7*2)  and  (15.7*5).  It  oan  ba 
aaan  by  tha  daflnitiona  of  thaaa  matrioaa  that  tha  product  ia  aymmatrlo, 

Wa  now  indicate  a  auparmatrix  of  tha  matrices  solved  for  in  Eqs,  (15*7*5) 
and  (15.7.4),  This  is  given  in  tha  right  hand  side  of  Eq.  (15*7.5).  The 
left  hand  side  of  Eq.  (15.7*5)  indicates  a  partial  triangular  factoring  of 
tha  auparmatrix, 

Tha  lowar  part  of  tha  laft  partial  triangular  factor  is  than  tha  first 
approximation  to  tha  factor  loading  matrix,  as  indicated  on  tha  right  of  Eq. 
(15*7.6). 

Tha  general  aquations  are  given  in  Eqs.  (15.7.7)  through  (15.7*15).  Eq. 
(15.7*7)  givos  the  general  aquation  for  tha  D_  matrix.  This,  as  indicated  on 
tha  right,  is  obtained  by  subtracting  from  tha  diagonal  of  tha  covariance 
matrix, the  diagonal  of  tha  major  product  moment  of  the  current  approximation 
to  the  factor  loading  matrix, and  then  taking  the  inverse  of  this  difference 
diagonal  matrix. 

Eq.  (l5.7*8)  gives  the  ith  approximation  to  the  U  matrix,  which  is  the 
current  approximation  to  the  factor  loading  matrix  premultipliad  by  the  di¬ 
agonal  matrix  of  Eq.  (15«7*7)* 

The  ith  approximation  to  the  W  matrix  is  given  by  Eq.  (15*7*9).  This  ia 
the  product  of  the  covariance  matrix  postmultiplied  by  the  U  matrix  calcu¬ 
lated  in  Eq,  (15.7.8),  less  the  previous  approximation  to  the  factor  matrix. 
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Eq,  (15*7,10)  indicates  the  ith  approximation  to  th#  symmetric  3  matrix, 
which  is  th#  minor  product  of  th#  V  and  W  matrices  calculated,  r«sp#otlv#ly, 
in  Bqs,  (15.7,8)  and  (15*7.9). 

W#  Indicate  in  gcnaral  th#  sup«rmatrix  mad#  up  of  th#  matrices  calcu¬ 
lated  in  Eqs,  (15,7,9)  and  (15.7.IO),  as  on  th#  right  hand  sid#  of  Eq. 
(15.7*11).  W#  then  indicate  th#  partial  triangular  factoring  of  this  super- 
matrix,  as  shown  on  th#  left  sid#  of  Eq,  (15.7,11), 

Th#  lower  metric  element  of  the  supermatrix  on  the  left  hand  side  of 
Eq.  (15,7.11)  gives  the  next  approximation  to  the  factor  loading  matrix,  as 
indicated  in  Eq,  (15,7,12).  Zt  can  be  proved  that  the  triangular  matrix  in¬ 
dicated  in  the  upper  element  of  the  left  hand  matrix  in  Eq.  (15,7.11)  con¬ 
verges  to  a  diagonal  matrix  whose  elements  are  the  largest  roots  or  basic 
diagonal  elements  of  the  scaled  covariance  matrix. 

We  than  assume  that  the  traces  of  successive  t  matrices  or  the  sums  of 
their  diagonal  elements  will  converge  to  seme  value.  Therefore,  as  indicated 
tn  Eq.  (15,7.13),  we  take  the  ratios  of  successive  traces  to  get  H  values. 
When  theae  are  sufficiently  close  to  unity  the  computations  cease, 

15.7.^  Numerical  Example,  We  use  the  same  correlation  matrix  as  in  the 
previous  methods.  For  the  aabitrary  matrix  we  take  the  first  four  principal 
axis  factor  vectors  of  this  matrix  as  found  in  previous  solutions. 

For  convenient  reference  the  first  four  principal  axis  row  vectors  are 
given  in  Table  I5.7.I. 

Table  15.7*2  gives  the  successive  traces  of  the  t  matrices  for  thirty 
iterations. 

The  first  row  of  Table  15*7,3  gives  the  variance  accounted  for  by  each 
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of  the  first  four  factors,  The  body  of  the  table  give*  the  first  four  oolunn 
factor  loading  vactors.  Thasa  faator  loadings  boar  Uttla  ralatlon  to  the 
principal  axis  factors  of  Tabla  15.7,1,  However,  again  it  is  apparant  that 
tha  fourth  factor  stay  ba  ignorad,  Whlla  tha  factor  loadings  ara  not  tha  Sana 
within  daclnal  arror  as  thosa  of  Tabla  15,6,3,  wa  may  oonpars  factors  with 
tha  tbrea  highest  loadings.  For  Tables  15. 6. 3  and  15,7,5  wa  have  as  compar¬ 
able  factors  respectively,  factors  1  and  2,  2  and  3#  5  and  1,  Again  it  nay 
bo  that  a  great  many  more  iterations  would  yield  a  matrix  considerably  dif¬ 
ferent  from  that  of  Table  15«7*3* 

15,8  The  Specificity  Progreooive  Faator  Matrix  Method 

15.8.1  Characteristics  of  tha  Method.  This  method  is  essentially  a 
combination  of  the  previous  two  methods.  It  uses  the  sane  scaling  rationale— 
that  is,  the  reciprocal  square  roots  of  the  residual  variances  of  tha  attri¬ 
butes.  It  starts  with  a  single  factor  and  proceeds  by  adding  successive 
factors. 

It  differs  essentially  frea  the  first  method,  however,  in  that  no  resi¬ 
dual  matrices  are  calculated.  Zt  is  similar  to  the  second  method  In  that 
only  a  single  scaling  of  the  variables  is  solved  for.  Zt  differs  in  that  no 
assumptions  are  made  as  to  the  number  of  factors  required, 

15.8.2  The  Computational  Equations 

15.8.2a  Definition  of  Notation 

(k)  subscript  designates  a  matrix  of  width  k. 

Other  notation  is  the  same  as  in  Section  15.7.2a, 
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Table  15,7,1  >  First  Four  Principal  Axil  Row  Fa q tor  Vectors  of  the  Correla¬ 
tion  Matrix 

0.717  0,740  0.775  0.556  0.1*63  0,910  0.640  0,615  0.715 

0,495  0.470  0.296  -0,649  -0.744  -0,694  0.080  0,166  -0.054 

0.550  0,522  0,406  0.068  0.181  0.188  -0.568  -0,621  .0.569 

0.050  -0.056  0.009  0.102  -0,115  -0.129  -0.288  -0,165  0,566 

Table  15.7,2  -  Traoes  of  Successive  t  Matrices  for  Thirty  Iterations 

67.5460  54.1554  54.0275 

57.4669  54.1246  54.0201 

55.5702  0.1747  54.0150 

54.6664  0.1646  54.0061 

54.5994  0.2455 

54.2859  0.4108 

54.2525  0.2609 

54.2055  0.5148 

54.1055  0.5076 

54.1725  0.5691 

54.1616  0.0514 

54.1518  54.0421 

54.1425  54.0546 

Table  15*7.5  -  Specificity  Factor  Matrix  Method.  Variance  Accounted  for 
and  Column  Factor  Vectors  for  First  Four  Factors 

2.8295  1*6250  1.6557  0.6243 

0.5091  0.7508  -0.0229  0.0439 
0.5297  0.7447  -0.0087  0.0093 
0.5390  0.6577  0.1617  0.0735 
0.4148  -0.1135  0.6337  -0.0521 
0.3020  -0.1292  0.7893  -0.0128 
0.3476  -0.0770  0.7470  -0.0199 
0.5858  0.0322  -0.0403  -0.5875 
0.5901  0.0384  -0.1302  -0.5152 
0.9611  -O.I897  -0.0760  0.0559 
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iw(k)  "  c  iu(k)  *  ia(k) 
i^k)  l^k)  *  iwik)  iu(k) 
l+la(k)  “  lW(k) 


(15.8.1) 

(15.8.2) 
(15.8.5) 

(15.8.4) 

(15.8.5) 

(15.8.6) 
(15-8.7) 
(15.8.8) 

(15.8.9) 

(15.8.10) 

(15.8.11) 

(15.8.12) 


15*8.3  Computational  Instructions,  This  method  begins  vlth  an  arbit¬ 
rary  vector  as  in  the  first  specificity  type  of  solution.  The  method  for 
getting  the  first  factor  vector  is  the  same  as  in  that  solution. 


Ws  next  proceed  to  indicate  a  factor  loading  matrix,  as  indicated  in  Eq, 
(15,0,1),  whsrs  now  k-1  is  the  number  of  faotors  currently  solved  for. 

We  then  indicate  an  augnented  matrix  to  which  one  more  faotor  has  been 
added,  as  indicated  in  Eq,  (15,6,2),  To  begin  with,  the  first  matrix  in  the 
parentheses  on  the  right  of  Eq,  (15,8,2)  is  simply  the  first  faotor  loading 
vector  a  This  is  augmented  now  by  a  second  arbitrary  vector  which  may 
be  assumed  to  be  a  reasonable  approximation  to  the  second  faotor  loading 
vector. 

We  then  have,  as  In  Eq,  (15.0,5),  a  diagonal  matrix  which  is,  as  in¬ 
dicated  on  the  right,  the  reciprocal  of  the  diagonal  of  the  covariance  matrix 
minus  the  diagonal  of  the  major  product  memont  of  the  matrix  in  Eq.  (15*8.2). 

We  indicate  in  Eq.  (15,8.4)  the  matrix  of  Eq.  (15.8.2)  premultiplied  by 
the  diagonal  matrix  of  Eq,  (15.8.3), 

Eq.  (15.8.5)  is  obtained  by  premultiplying  the  matrix  of  Eq.  (15.8.4)  by 
the  covariance  matrix  and  subtracting  the  arbitrary  approximation  to  the 
factor  matrix  frcm  it. 

Eq,  (15.8,6)  indicates  the  minor  product  moment  of  the  matrices  of  Eqa. 
(15.8,4)  and  (15.8.5)  as  a  major  product  of  a  partial  triangular  matrix.  In 
particular,  this  could  be  solved  for  by  means  of  the  partial  triangular  factor 
ing  of  the  supermatrix  indicated  in  Eq.  (15.7*5)  of  the  previous  method, 

Eq.  (15.8.7)  gives  the  first  approximation  to  the  factor  loading  matrix 
of  width  k  as  the  W  matrix  of  Eq.  (15.8.5)  postmultiplied  by  the  inverse  of 
the  upper  triangular  matrix  of  Eq.  (15.8.6). 

The  general  iterative  type  of  solution  is  indicated  by  Eqo.  (15.8.8) 
through  (15.8.12),  Here  the  equations  are,  respectively,  the  same  as  Eqs. 
(iS.8.3)  through  (15.0.Y),  except  that  now  the  px'esorlpt  benomes  i^  for  the 


ith  approximation.  Zn  thin  typo  of  aolutlon  vo  may  again  ltorato  to  acms 
convergence  oritorlon  for  tho  trace  of  tho  triangular  matrix;  indicated  on 
the  left  of  Eq.  (lJ.&.U),  If  the  traaee  of  two  euooeeaitve  t  matricee  are 
eufficiently  close,  we  may  assume  that  the  approximation  is  sufficiently 
close  for  the  ourrent  number  of  faotors;  k. 

Once  this  criterion  has  been  satisfied;  ve  again  augnent  the  currently 
stabilised  factor  loading  matrix  by  another  arbitrary  vector;  which  is  pre¬ 
sumably  reasonably  orthogonal  to  the  current  factor  vectors  and  which  is  not 
too  poor  an  approximation  to  the  next  factor  vector  ve  wish  to  obtain. 

We  then  proceed  again  through  Eqs,  (15,8.2)  to  (15,8,7)  to  get  a  first 
approximation  to  the  factor  loading  matrix  with  ono  more  factor  added, 

doing  through  Eqs.  (15,8.8)  through  (15.8.12),  we  oontinue  to  ltorato, 
increasing  the  value  of  subscript  1.  until  the  solution  has  stabilized  to  come 
specified  tolerance  with  reference  to  the  traces  of  two  successive  t  matrices. 
We  proceed  to  augnent  tho  matrix  in  Eq,  (15,8.2)  until  we  have  accounted 
for  enough  factors,  according  to  some  specified  criterion.  This  criterion 
may  well  be  simply  the  suras  of  squares  of  elements  of  a  currently  stabilized 
a  matrix,  such  as  given  in  Eq.  (15,8,12).  The  sums  of  squares  of  these  ele¬ 
ments  are,  of  course,  the  amount  of  variance  accounted  for  by  the  given  number 
of  factors, 

15.0 A  Numerical  Exomplo,  We  use  the  same  correlation  matrix  as  in  the 
previous  section.  In  this  numerical  example  we  use  as  the  arbitrary  vector 
for  each  new  factor  the  corresponding  principal  axis  vector  of  the  correla¬ 
tion  matrix. 

The  first  row  of  Table  15,8,1  gives  the  variance  accounted  for  by  each 
of  the  first  four'  factors.  The  body  of  the  table  gives  tho  first  four  factor 
vectors.  Again  it  appears  that  the  fourth  factor  may  bo  ignored. 
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Table  13,0,1  •  Specificity  Frogreaaive  Factor  Matrix  Method* 
Accounted  for  and  Flrat  Four  Factor  Vectors 

3.3946  1.0123  1.0936  0.2634 

0,0251  -0,3481  -0.1503  -0.0012 
0,0444  -0.3236  -0.1332  0.0332 

0,0203  -0.1577  -0.2403  -0.0311 
0.3659  0.6436  -0.2006  O.OO83 

0,2014  0.7159  -0,3664  0.0805 

0.3410  O.6670  -0.3468  0.0579 
0.5341  0.2126  0.4568  0.2343 

0,5445  0.1573  0,5665  0.2987 

0.6458  0.3463  0.4095  -0.3276 


Variance 
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15*9  The  Ccwsunallty  Qucoesslve  Factor  Msthod 

Ws  shall  now  consider  th#  first  of  tha  ocomunollty  olass  of  scaling 
methods,  In  thasa  mathods  va  hava  tha  thraa  dlffarant  types  of  solutions— 
namely,  tha  suooasslva  factor  vector  solution,  tha  factor  matrix  solution, 
and  tha  progressive  factor  matrix  solution*  These  mathods  are  essentially 
tha  same  as  tha  specificity  scaling  methods  except  that  the  sooling  diagonal 
is  different,  and  no  diagonal  matrix  is  subtracted  from  tha  correlation  matrix* 
Hare  tha  scaling  constants  a re  inversely  proportional  to  tha  square  roots 
of  tha  variances  accounted  for  by  the  vectors  solved  for.  This  principal  of 
scaling  is  just  tha  opposite  of  that  used  in  the  specificity  method*  In  tha 
spacifloity  mathod  the  scaling  is  such  that  the  variance  unaccounted  for  by 
tha  faatora  is  tha  same  for  all  variables,  vhile  in  the  coonunality  method 
the  scaling  is  such  that  tha  variance  accounted  for  by  the  factors  is  the 
same  for  all  variables.  In  this  latter  procedure  it  is  assumed  that  more 
weight  should  be  given  to  the  variables  which  otherwise  would  hava  less  of 
their  variance  accounted  for  by  the  factors. 

We  begin  now  with  the  computational  equations  for  the  successive  factor 
method, 

15*9.1  The  Computational  Equations 
15.9.1a  Definition  of  Notation 

C  la  a  correlation  or  covariance  matrix. 

V  is  an  arbitrary  vector, 

jO  ta  the  ith  approximation  to  a  factor  vector. 

D  is  a  diagonal  matrix  of  the  elements  of  .a, 
ia  — 
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Ht  t$  a  toUranoa  limit, 
knc  1*  th«  kth  root  dual  matrix* 

15.9.1b  Th*  Equations 


0*  ■  c  v  (v'  a  v)*i 

(15.9.1) 

0°  ■  £ 

(15.9.2) 

0U  ■  o01 

(15.9.3) 

0M  ■  °0V 

(15.9.4) 

°b  ■  —7— 

(15.9.5) 

1°  ‘  oWob 

(15.9.6) 

iD  '  D*. 

(15.9.7) 

tu  -  101 

(15.9.0) 

jtf  -  C  jtf 

(15.9.9) 

at  ■  — - — 

/l"'  !» 

(15.9.10) 

1+Ia  “  1M  ^ 

(15.9.11) 

r-i-  .1  ■  H, 

“in  1 

(13.9.12) 

*.l  ’  1+1* 

(13.9.13) 

ac  ■  0  •  *.i  *Ii 

(13.9.14) 

k+ic  ■  kc  '  \k  *Ik 

(15.9.15) 

15.9.2  Computational  Znstruotlons. 

The  computational  procedure  for 

this  method  la  the  aame  aa  for  the  corresponding  method  in  the  apeoifloity 
olaaa  of  solutions,  except  that  the  matrix  and  the  W  vector  are  calculated 
differently. 

By  moane  of  an  arbitrary  vector  V  we  first  calculate  the  rank  reduction 
Qa  vector  as  in  Eq.  (15.9.I). 

Next  we  take  the  inverae  of  the  elements  of  the  Qa  matrix  given  in  Eq. 
(1S.9.1)  to  construct  the  D  matrix  given  in  Eq.  (13.9.2).  This  is  a  diagonal 
matrix  of  tho  Inverse  of  the  elements  in  the  vector  given  by  Eq.  (15.9.1). 

Eq.  (15.9.3)  indicates  U  as  a  vector  of  the  elements  of  the  D  matrix 
given  by  Eq.  (15.9.2). 

Eq.  (13.9.4)  ia  the  C  matrix  postmultiplied  by  the  U  vector  of  Eq. 
(15.9.3). 

Eq.  (15.9.5)  is  a  scalar  quantity  which  is  the  reciprocal  square  root 
of  the  minor  product  of  the  vectors  of  Eqs.  (15.9.3)  and  (15.9.4). 

Eq.  (15.9.6)  gives  the  W  vector  of  Eq.  (15.9.4)  multiplied  by  the  scalar 
of  Eq.  (15.9.5). 
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&!•«  (19.9*7)  through  (15.9.11)  indicat*  th*  iteration*  a*  in  the  anal 
ogous  specificity  method. 

Eq.  (15.9.12)  indicat**  th*  tolerance  limit  which  ia  assumed  to  give  a 
aufflolontly  cloa*  approximation, 

Th*  1+1  approxioation  to  a  ^  la  than  taken  a*  th*  firat  faotor  vector, 
a*  indicated  in  Eq.  (15.9.13). 

Eq.  (19.9.14)  give*  th*  firat  rsaldual  oatrix  as  in  th*  spooifioity 
method, 

Eq.  (19.9.15)  give*  a  generalisation  of  Eq.  (19.9.14), 

Th*  procedure*  for  Eq*.  (19.9.1)  through  (15.9.13)  are  applied  to  th* 
■ucceaalve  residual  matrices, 

19.9.3  Numerical  Example.  We  use  the  same  correlation  matrix  as  in 
the  three  previous  examples  to  illustrate  this  method.  The  unit  vector  is 
taken  for  the  arbitrary  vectors.  The  computations  are  a  little  Bimpler  with 
respect  to  the  0  matrix,  since  it  involves  only  th*  factor  loading  vector 
and  does  not  Involve  elements  fran  the  covariance  matrix. 

Th*  firat  row  of  Table  15*9.1  gives  the  number  of  Iterations  for  each 
of  three  factoro.  The  second  row  gives  the  variance  accounted  for  by  each 
factor.  The  body  of  the  table  gives  the  first  three  factor  loading  vectors. 
15.10  The  Conanunality  Factor  Matrix  Solution 

15.10.1  The  Computational  Equations 

15. 10. la  Definitions  of  Notation 

C  is  a  covariance  or  residual  matrix. 

^a  la  the  tth  approximation  to  the  factor  matrix. 
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T*M.  -  CamumUty  QuoomsIv.  Factor  flolution.  Numbar  of  Iteration., 

V.rtano.  Accounted  for,  and  Fir.t  Tbr.t  Fiwtor. 


5  ^  50  30 

3.7106  1.8969  1.3096 


0.6398  0,3749  0.4982 
O.6639  0.3751  0.4818 
0.7117  0.2347  0.5164 
0,6326  -0.5577  -0.2927 
O.5685  -0.6786  0.0257 
0,6087  -0,6347  0.0133 
0.6351  0.3527  -0.4426 
0,6053  0.4040  -0,4655 
0.7002  0.3139  -0.2522 
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and  (lj.10,6)  and  tha  W  matrices  of  Eqs,  (15,10,3)  and  (13,10,8)  art  oalcu- 

0 

latad  dlffarantly,  Zt  will  be  Man  that  tha  D_  natrlcaa  ara  obtalnad  by 
taking  tha  reciprocal  of  tha  diagonal  of  tha  major  product  sonant  of  tha 
factor  loading  matrix,  rather  than  by  subtracting  this  diagonal  from  tha 
original  diagonal  of  variances,  Shis  difference  in  tha  calculation  of  tha 
D  matrices  reflects  tha  difference  in  tha  underlying  rationale  of  tha  method, 
Tha  W  matrices  ara  different  in  that  they  do  not  involve  tha  subtraction  of 
the  current  a  matrix. 

It  will  be  noted  that  Eqs,  (15,10,4)  and  (15*10.9)  Indicate  tha  minor 
product  of  tha  W  and  the  V  matrices  as  the  major  product  mcoent  of  partial 
triangular  factors.  These  aquations  do  not  explicitly  indicate  the  partial 
triangular  factoring  of  a  type  3  supervector,  as  indicated  in  Eqs.  (15.7.5) 
and  (15.7.11).  However,  the  computations  may  be  carried  out  in  the  seme 
fashion, 

15.10.3  Numerical  Example,  Again  we  take  the  same  correlation  matrix 
as  in  the  previous  illustrations.  We  also  take  its  first  four  principal  axis 
vectors  as  the  arbitrary  matrix. 

Table  15.10.1  gives  the  first  four  factor  loading  vectors  for  the  cor¬ 
relation  matrix  as  determined  from  the  rescaled  matrix.  These  are  consider¬ 
ably  different  frcm  those  in  Table  15.9.1* 
i5.ll  The  Commonality  Progressive  Factor  Matrix  Method 

15.11.1  Computational  Equations 

15. 11. la  Definition  of  Notation 

C  is  the  covariance  or  correlation  matrix. 

Ml 

^a^  i*  the  1th  approximation  to  a  factor  loading  matrix  of  width 
k. 


Table  5,10,1  •  Communal ity  Faotor  Matrix  Method,  Ft ret  Four  Factor  Vectors 


0,6927  0,5144 
0,7165  0.5022 
0.7595  0.5215 
0.5905  -0,6276 
0,4992  -0.7255 
0,5515  -O.6716 
0.6569  0.1505 
0,607a  0.21 66 
0.7055  0.0150 


0,5644  -0,0512 
0,5546  -0.0535 
0,4158  0.0155 
0,0442  O.I678 
0,1528  -0.1554 
0,1655  -O.1568 
-0,5901  -0.2626 
.0,6256  -0.1525 
-0.5522  O.5509 
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D  .  *  la  a  matrix  of  tho  diagonal  of  .a/v»  ,al. 

ia(k)  ia(k)  U*LLm 


13. 11, lb  The  Equatlona 

a(k-l)  '  (\l"a.k-l> 
0a(k)  "  ^a(k-l)  *  0a> 

°D(h)  °oa(k)  0a(k) 

0U{k)  “  0D(k)  0a(k) 

0W(k)  “  0  0U(k) 

Ot(lc)  O^k)  *  oW(k)  0U(k) 
la(k)  *  oW(k)  O^k) 
lD(k)  "  Dta(k) 
lU(k)  -  lD(k)  la(k) 
lW(k)  “  C  iU(k> 
i^(k)  i^fe)  "  iW(k)  lU(k) 
l+lB(k)  "  lW(k)  ltfk) 


(15.11.1) 

(15.11.2) 
(15.11.3) 
(l5.ll.k) 

(15.11.5) 

(15.11.6) 
(15.11.7) 
(15.11.0) 

(15.11.9) 

(15.11.10) 

(15.11.11) 

(15.11.12) 
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(15.U.15) 


15.11.2  Computational  Instructions,  Hera  the  computational  procedure 
Is  essentially  ths  sans  as  that  of  ths  corresponding  specificity  method,  ex¬ 
cept  that  again  the  0  matrices  are  calculated  only  as  the  major  product  moment 
of  the  factor  loading  matrix  and  the  W  matrices  do  not  involve  the  subtraction 
of  the  current  approximation  to  the  factor  loading  matrix* 

15*11*5  Numerical  Example,  The  correlation  matrix  is  the  same  as  in 
the  previous  examples* 

The  first  row  of  Table  15*11.1  gives  the  variance  accounted  for  by  each 
of  the  first  three  faators*  The  body  of  the  table  gives  the  three  factor 
vectors. 

Although  the  three  ccomunality  scaling  methods  give  different  results, 
the  general  ordors  of  magnitude  of  the  factor  loadings  canpara  favorably  with 
one  another  and  with  the  corresponding  principal  axis  factor  loadings.  The 
signs  for  corresponding  elements  of  all  four  seta  are  the  same  for  the  first 
three  factors, 

15.12  Mathematical  Proofs 

15.12.1  Proof  of  the  Specificity  Successive  Factor  Method 

Let  C  be  the  correlation  of  the  covariance  matrix,  and  consider 

C  -  D’2  -  a  a'  -  jC  (15.12.1) 

where  a  is  a  vector  or  matrix  of  specified  width  and 

D  -  (Dc  -  a,  )“*  (15.12.2) 


We  let 


Table  15,11,1  -  Carwunallty  Progreeelve  Faator  Matrix  Method, 
Aacounted  for  and  Flret  Three  Faator  Veatore 


5.7345 

2.0508 

1.3421 

0,6655 

0.5042 

0,4242 

0.6904 

0.4932 

0.3969 

0,7306 

0.3103 

0,4711 

0,5664 

-0.6275 

0.0621 

0,4908 

■0.7257 

0,1613 

0.5429 

-0.6746 

0.1763 

0,6630 

0.1528 

-0.5376 

0.6331 

0.2390 

-0.5627 

0.7476 

0.0312 

-0.3406 

Varlanoe 
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D  a  ■  a 


(15,12.5) 


o  (c  -  o'2)  oa  -  a  a'a  (15.12.4) 

We  may  begin  with  acne  approximation  to  the  first  principal  axis  vector  suoh 
ae  the  centroid.  We  let  this  vector  be  ^a,  and  calculate 

0D2  -  (Dc  -  D^)-4  (15.12.5) 

Then  consider 

oD  1*  •  oD  Ic  ■  a0'2’  o"2  0*  [o*’  o°  (c  -  o°'2>  oD  o*1-4  (15as-c) 

which  la  a  rank  reduction  form. 

We  lot 

0°  ’  O^o*  (15-“-7) 

From  Eqa.  (15.12.6)  and  (15.12.7) 

La  -  (C  -  0D’2)  QU  tQU'  (C  -  0D‘2)  0U]"*  (15.12.8) 

If  ve  let 

0W  •  c  oU  “  oa  (15.12.9) 


and 


Then  from  Eqs,  (15.12.8),  (lj.12.9),  and  (15. 12.10), 

ia  "  owoa 


(15.12.10) 


(15.12.11) 
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Xn  general  than,  va  hava 


1U  -  1D  V 


(19.13.12) 


(15.12.13) 


tW  ■  c  tu  -  t» 


(15.12.14) 


1+1*  "  iWia 


(15.12.15) 


(15.12.16) 


W«  nay  continue  until  .a  atabilizoa  and  than  caloulata  tha  realdual 


i°  •  0  •  *.i  *!i 


(15.12.17) 


Ilia  operations  on  jC  are  the  aone  as  for  C.  Suocesnive  residual  ^C* s  nay  be 
obtained  to  a  specified  number  of  factors. 

We  show  in  Section  15*12.7  that  the  solution  ia  independent  of  scale. 
15.12.2  Proof  of  the  Specificity  Factor  Matrix  Method 
Let  a  be  a  factor  loading  matrix  of  specified  width.  We  nay  still  use 
Eqs.  (15.12.1)  through  (15.12.7)  without  loss  of  generality.  We  now,  how¬ 
ever,  introduce 


0*0*  -  ow'ou 


(15.12.1s) 


Analogous  to  Eq.  (15. 12.11),  we  now  write 

ia  "  ow  otri 


(15.12.19) 
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(19.12.20) 

(19.12.21) 

(19.12.22) 

(19.12.29) 

(19.12.24) 


The bo  Iterations  may  aontinue  until 

tr  (1+1t)  -  tr  (tt)  -  P  (19.12.25) 

for  P  sufficiently  small.  Then  ^t  will  approach  the  baulo  diagonal  &  of 

DCD-1  ■  QB  Q'  (15.12.26) 

and 

•  Da  .  a  (15.12.27) 


That  this  solution  is  independent  of  scale  is  shown  in  Section  15.12.7. 
15.12*3  Proof  of  the  Specificity  Progressive  Factor  Matrix  Method 
Let  Eqs.  (15.12.20)  through  (15.12.24)  be  the  iterative  procedure  for  a 
of  width  k.  In  particular,  k  may  be  1.  Continue  until  Eq.  (15.12. 25)  is 
satisfied  and  indicate 


1 


•  •  ♦ 


(15.12.28) 


no 


or  tooner. 

Here  also  th*  eolution  It  independent  of  taale,  at  thown  in  Section 
15.12*7* 

15*12*4  Proof  of  tha  Ccomunality  Suacettive  Factor  Vector  Method 
Let  C  be  the  covariance  matrix  and  oontlder  the  rank  reduction  vector 
Qa  given  by 

Qa  -  C  V  (V'  C  V)"i  (15.12.41) 


where  V  it  arbitrary. 

We  Indicate  a  diagonal  of  the  elemento  of  Qa  by 

D  ■  o'* 

0  oa 

Let 


C  0°  o1 


(na' 


J>2  C  J32 


(15.12.42) 


(15.12.43) 


In  general,  let 

,D  -  D*  (15.12.44) 

1  i* 

and 

l+1a  -  C  1D2  L a  (f'  tD2  C  p2  (15. 12.45) 


Let 

.U  -  0*  1  (15.12.46) 

1  ia 

Frca  Eqs.  (15,12.44)  and  (15.12. 46) 

AU  -  1D2  a  (15.12.47) 


Ill 
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Than  consider  an/  scaling  diagonal  4  auoh  that 

A  -  A  a  (15.12.57) 

7  -  AC  A  (15.12.50) 

and 

A  -  7  Dj  1  (1'  dJ  c  dJ  i)‘*  (15.12.59) 

Substituting  Eqa.  (15.12.57)  and  (15.12.50)  In  Eq.  (15.12.59) 

A  a  -  A  C  A  (A®  D*  1)  tl'  D*  A*  (A  D  A)  A*  D*  ll"^  (l5.12.6o) 

A  A  A 

Eq.  (15.12.60)  raducas  at  onea  to  Eq.  (15.12.56). 

Once  a  ^  la  obtained,  we  cun  solve  for  a  residual  matrix. 

.C  -  C  -  a  .  a'  (15.12.61) 

X  «X  tl 

and  operate  on  .C  as  before  to  obtain  a  The  procedure  is  readily  gen- 

X  wmUi 

e rail tod  to  any  number  of  factors. 

15.12.5  Proof  of  the  Communality  Factor  Matrix  Mathod 

Let  C  be  the  covariance  matrix  and  consider  the  approximate  solution 

C  -  a  a'  «  jC  (15.12.62) 

where  the  width  of  a  la  chosen. 

We  lot 

D*2  -  Da  (15.12.6?) 

and 

(15.12.6H) 


Da  >  a 


U3 


Consider  also 


D  n  Da  •  a  (a'  a) 

(15.12.65) 

W«  aunume  a  of  fixed  width  and  start  with,  soy,  a  principal  axis  or  some 
other  approximation  to  a.  We  eall  this  solution  Qa,  We  let 

a 

°D  ’  °oV 

and 

(15.12.6 6) 

oa  •  oD  0* 

We  thon -consider  the  matrix  reduction  solution 

(15.12.67) 

1*  1*'  ■  C«'o»  <0a'  0°  0  oD  o“>'*  o“’  0D  c 

We  let 

(15.12.68) 

ou  ■  oD%* 

From  Eqn,  (l5.12.6h)»  (15. 12.68),  and  (I5.i2.69) 

(15.12.69) 

1‘  1*'  -  *  0“  <0°*  "0  o">“  0°‘  8 

We  let 

(15.12.70) 

0"  ■  »o“ 

(15.12.71) 

0*  0*'  *  0”'  ou 

(15.12.72) 

T 

O 

O 

S 

(15.12.73) 

or  in  tjeneral 

iD  *  D*i  »'  (15.12.7'*) 
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tU  .  f  t* 


(15,12,75) 


4«  -  0 


(15.12.76) 


tt  *t'  .  tw»  tu 


(15.12.77) 


1*1*  "  1W  i t# 1 


(15.12.76) 


Eqs.  (15.12.74)  through  (15.12. 70)  continue  until  In 


tr  (1+1t)  -  tr  (1t)  ■  P 


(15.12.79) 


P  la  sufficiently  small.  As  I  Increases,  will  approach  a  diagonal  matrix 
of  the  basic  structure  of  R  J)  or,  in  general, 


\t  -  ia'  i° 


(15.12.80) 


We  can  show  hy  Section  15.12.7  that  this  procedure  is  independent  of  scale. 
15.12.6  Proof  of  the  Communality  Progressive  Factor  Matrix  Method 
let  Eqs.  (15.12.74)  through  (15.12.70)  he  the  iterative  procedure  for  a 
of  width  k  where  k  >  1,  We  continue  until  Eq.  (15. 12.79)  is  satisfied  and 


a(k)  *  (a.l  -•  a.k) 


(15.12.81) 


We  then  let 


*(k+l)  “  (a(k)  »  oa) 


(15.12.82) 


where  Qa  ia  determined  in  some  suitable  manner.  In  particular,  we  may  consider 


and  1st 


U5 

k+lfl  "  0  '  a(k)  a(k) 


(15.12,65) 


**1°  1  <1'  1>'J 


(15. 12,04 ) 


where  obviously  the  operations  in  Eq,  (15,12,84)  oan  bs  performed  directly 
with  0  and  a^  so  that  need  not  be  computed, 

Me  then  let 


V(k+1)  Oa(k+l) 


0U  "  0D  Oft(k+l) 


(15.12.65) 

(15.12.86) 


0W  "  C0U 


(15.12.07) 


„t  nt>  m  U>  U 
0  0  0  0 


(15.12.60) 


oa  +  ow  0t/H 


(15.12.a9) 


and  in  general, 


i°2  "  D\  a' 

1  i  (k+1)  i  (k+1) 

(15.12.90) 

iU  "  i°2  ia(k+l) 

(15.12.91) 

iW  *  C  itf 

(15.12.92) 

it  lt»  -  /  4U 

(15.12.93) 

i+la  a  iaiwitrl 

(15.12.94) 
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We  continue  until 

i.JLiii 

tr  (C) 


•  P 


(15.12.95) 


la  fluff lolently  onall. 

Hope  alito  the  aolutlon  la  Independent  of  aoale  aa  ahown  In  Section 
15.12.7. 

15.12.7  Proof  of  the  Generalized  Procedure  Independent  of  Scale 
Given  the  n  x(n  covariance  matrix  C  and  the  n  x  k  factor  matrix  a. 
Consider 


■  C  -  a  a' 


Lot 


«  DC  +  f  Da  a' 


(15.12.96) 


(15.12.97) 


where  g  and  f  are  acalars.  Consider  the  basic  structure  rank  reduction 
solution 


a  -  C  D*  a  (a'  D*  C  D*  a)’*  h 


where  h  la  a  squaro  orthonormal.  Let  A  be  diagonal  and 


y  •  A  C  A 


A  a 


5  -  «  Dy  ♦  f  V 


(15.12.98) 

(15.12.99) 

(15.12.100) 
(15.12.101) 


i 


■  u7 

and  eonsider  the  ba#lo  structure  rank  reduotion  solution 

A  -  y  ft*4  A  (A'  5*  7  54  A)*^  h  (15.12.102) 

Prom  Bqs.  (15.12.96),  (I5.12.99)i  and  (19.12.100)  in  (15.12.101) 

6  -  A2  D  (15.12.103) 

Prom  Eqa.  (15.12.99).  (15. 12.100),  and  (15.12.10))  in  (15.12.102) 

a  -  C  D4  a  (a*  o'*  C  D*  a)“^  h  (15.12.10k) 

which  is  the  same  as  Eq,  (15.12.98). 

Now  wa  lot 

a  -  6’^  A  (15.12.105) 

From  Eqo,  (15. 12.100)  and  (l5.12.10j)  In  (15.12.105) 

0  -  D”^  a  (15.12.106) 

which  shows  that  a  is  Independent  of  A  and  depends  only  on  g  and  f  In  Eq. 
(l5.12.97).  If  we  let  fi  *  0,  f  *•  1,  we  get  the  coramunality  scaling  type 
solutions.  If  we  let  g  ■  1,  f  ■  0,  we  get  the  conventional  basic  structure 
solution  applied  to  the  correlation  matrix. 

We  may  now  substitute  C  -  D  for  C,  and  £  -  S  for  £1  and  show  that  a  i3 
independent  of  A  and  depends  only  on  g  and  £.  Then  for  g  *  1  and  f  ■  -1  we 
get  the  specificity  scaling  type  of  solutions. 


CHAPTER  16 


IMAGE  ANALYSIS 

In  earlier  chapter*  vs  have  reforrsd  to  tiia  ccmmunality  problem  and  have 
Indicated  that  Aram  a  computational  point  of  view  v*  nay  be  concerned  with 
solving  for  unknown  diagonal  elements  of  the  correlation  or  aovarlance  matrix 
in  suoh  a  way  that  the  modified  matrix  is  of  lower  rank  than  the  original. 
Presumably  the  original  matrix  will  be  baslo  in  moot  cases. 

Whether  we  eon  select  diagonal  elements  so  that  the  matrix  without  alter¬ 
ations  In  the  offdiagonal  elements  is  of  lower  rank  than  the  original  is  a 
quaotion  of  fact.  WO  know  that  in  some  cases  this  cannot  be  done  except  for 
a  rank  reduction  of  1.  It  is  well  known  that  experimental  covariance  matri¬ 
ces  con  in  general  be  reduced  to  a  rank  one  less  than  their  order  by  a  change 
in  one  diagonal  element. 

There  are,  of  course,  as  many  diagonal  elements  ns  the  order  of  the 
matrix,  so  that  there  would  be  n  ways  that  the  matrix  could  be  reduaed  in 
rank  by  at  least  1.  Actually,  in  the  case  of  the  correlation  matrix,  we 
know  that  this  diagonal  element  which  for  any  particular  variable  will  re¬ 
duce  the  rank  of  the  matrix  by  1,  is  the  squared  multiple  correlation  of  that 
variable  with  all  of  the  others. 

The  problem  of  communal!  ty  and  how  to  solve  for  the  unknown  elements 
has  been  very  troublesome  over  the  years.  Many  investigators  are  becoming 
convinced  that  the  questions  have  not  been  properly  Btatod  and  that  the  prob¬ 
lem  has  not  been  properly  formulated. 

We  have  seen  in  the  previous  chapter  that  another  vay  of  looking  at  the 
problem  is  from  the  scaling  point  of  view.  It  should  be  remembered  that  the 
caranunality  problem  has  its  origin  and  basic  motivation  from  a  consideration 


of  hypotheses  about  the  kind*  of  factor*  which  may  exist  in  a  set  of  variable*. 
These  are  factors  which  are  cownon  to  two  or  more  of  the  variables,  and  factors 
which  are  specific  to  each  of  the  variables.  This  does  not,  however,  suggest 
specifically  a  mathematical  formulation,  because  the  unique  variance  must  con¬ 
sist  of  both  systematic  specific  variance,  and  error  or  unsystematic  specific 
variance. 

Another  approach  to  the  solution  of  the  issues  involved  In  the  comraun- 
ality  controversy  ha*  In  rocent  years  received  considerable  emphasis  under 
the  impetus  of  Louis  Cuttwon  (1953).  His  work  has  offered  sane  hope  of 
(jetting  out  of  some  of  the  dilemmas  and  contradictions  Involved  in  the  tradi¬ 
tional  formulations  of  the  ooaaunolity  problem.  This  approach  is  based  on 
what  he  terns  image  analysis.  The  notion  here  is  that  a  factor  analysis  should 
be  concerned  primarily  with  that  part  of  each  variable  which  can  be  estimated 
from  all  of  the  othor  variables  in  the  set,  and  that  as  much  as  possible  of 
the  specific  variance  should  be  eliminated. 

We  shall  therefore  consider  in  this  chapter  a  group  of  methods  based 
on  Outtman's  image  analysis  which  are  somewhat  different  from  those  considered 
in  the  previous  chapter.  Tho  methods  of  Chapter  15  operate  upon  a  transformed 
score  matrix  in  which  the  transformation  consists  of  multiplication  by  a  scal¬ 
ing  diagonal.  In  the  examples  here,  we  also  work  with  the  transformed  score 
matrix,  in  that  the  matrix  is  multiplied  on  the  right  by  another  matrix.  The 
matrix  in  thi9  case,  however,  is  not  a  diagonal  matrix  but  a  more  general  type 
of  matrix  which  we  shall  develop  in  detail  in  the  following  sections, 

1(5,1  Characteristics  of  the  Methods 

We  ahall  consider  now  the  characteristics  which  are  common  to  all  of 


these  methods,  First,  all  of  tho  methods  are  baaed  on  the  Image  matrix,  which 
la  tha  matrix  consisting  of  tha  part  of  each  variable  which  can  ba  predicted 
by  ull  tha  remaining  ones,  Second,  tha  calculation  of  tha  invaroa  of  tho  cor¬ 
relation  matrix  la  required  In  all  of  the  solutions.  The  problem  of  sealing 
of  the  variables  la  a  consideration,  but  the  methods  differ  essentially  in 
the  arbitrary  scaling  procedures  adopted.  Third,  the  correlation  matrix  should 
be  basla.  Finally,  the  solutions  are,  In  general,  basic  structure  solutions. 

16.1.1  The  Communallty  Score  Matrix,  The  basis  for  all  of  these  methods 
is  a  matrix  derived  from  tho  data  matrix  by  conventional  least  square  proced¬ 
ures,  In  effect,  one  gots  the  best  least  square  estimate  of  eaoh  attribute 
vector  in  the  data  matrix  from  all  of  the  remaining  n-1  vectors.  In  this  vny 
one  gets  a  matrix  of  least  square  estimates  of  the  data  matrix  vectors.  Actu¬ 
ally,  one  does  not  go  through  the  tedious  and  detailod  operations  of  calculat¬ 
ing  the  ragresalon  equations  and  the  estimated  vectors.  By  algebraic  short¬ 
cuts  one  arrives  at  a  matrix  which  transforms  the  original  data  matrix  into 
tills  so-called  image  or  estimated  data  matrix.  Also,  in  practice,  one  does 
not  operate  directly  on  the  data  matrix,  but  rather  on  a  correlation  or  co- 
variance  matrix  derived  from  it. 

16.1.2  Calculation  of  tha  Inverse,  The  methods  considered  in  this 
chapter  differ  essentially  from  all  of  those  we  have  considered  previously 
in  that  the  calculation  of  the  inverse  of  the  correlation  matrix  is  required 
as  a  basis  for  the  solution.  For  this  reason  the  computations  can  be  con¬ 
siderably  more  involved  than  previous  methods  we  have  considered.  The  compu¬ 
tation  of  the  inverse  of  a  very  large  matrix  involving  several  hundred  or 
more  variables  is  in  itself  an  appreciable  computational  enterprise.  It  is 
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therefore  only  sinoe  ths  advent  of  the  high  speed  electronic  computers  that 
mathoda  of  factor  analysla  baaed  upon  the  image  analyulo  approach  of  Outtman 
have  beooms  feasible, 

16,1«)  Scaling  Considerations,  The  essential  dlfferenoea  In  tha 
methods  we  shall  oonoider  are  those  involving  scaling  of  the  variables  after 
the  original  data  matrix  has  been  converted  to  on  image  or  estimated  matrix* 
These  scaling  methods  ore,  however,  considerably  simpler  than  those  in  the 
previous  ohaptsr  where,  as  we  recall,  elaborate  iteration  procedures  were  re¬ 
quired  to  arrive  at  a  scaling  matrix  for  each  of  the  models  presented*  In 
this  set  of  methods,  one  adopts  a  simple  and  perhaps  arbitrary  rationale  for 
the  ocaling  of  the  variables,  and,  proceeding  from  this  scaling  on  the  co¬ 
variance  matrix  of  the  estimated  variables,  ona  does  not  attempt  to  alter  it 
by  successive  approximations  aa  In  tha  previous  chapter.  It  is  possible  with 
these  models  to  solve  for  scaling  constants  aa  in  Chapter  15 ,  However,  the 
fruitfulness  of  such  approaches  has  not  yet  been  demonstrated, 

16,1.4  The  Basic  Correlation  Matrix.  In  the  methods  discussed  in  this 
chapter  we  must  have  a  busia  correlation  matrix.  This,  of  couroe,  follows 
from  the  fact  that  we  work  with  tho  inverse  of  the  correlation  or  covariance 
matrix  au  part  of  tho  general  procedure.  In  the  poet  it  has  been  true  that 
moat  of  the  correlation  matrices  on  which  factor  analyses  were  performed  were 
basic  and  did  have  a  regular  inverse.  Therefore  this  restriction  in  the 
method  has  not  been  a  practical  or  serious  one.  However,  we  may  very  well 
encounter  correlation  matrices  which  are  not  basic.  The  most  obvious  case 
is  the  one  in  which  we  have  more  attributes  than  entities  or  persona.  An  ex¬ 
ample  la  the  personality  inventory  for  which  we  wish  to  consider  each  item  on 


the  inventory  at  a  vne labia.  Wo  may  have  many  hundrods  of  item*  In  tho  in¬ 
ventory,  and  it  may  ba  administered  to  only  a  hundred  persona,  Aotually,  in 
the  experimental  situation,  one  is  faoed  with  the  problem  that  the  longer  the 
inventory  to  be  administered  for  research  purposes,  the  more  dlffloult  it  io 
to  omasa  oases  or  entitles  whioh  have  responded  to  the  inventory.  Therefore, 
in  practical  situations  there  is  a  tendency  to  find  an  Inverse  relationship 
betweon  the  number  of  variables  and  the  number  of  entities.  This  is  a  con¬ 
sequence  of  the  limited  time  which  potential  subjects  have  available  for  tak¬ 
ing  the  inventory* 

Zn  any  case,  the  correlation  or  oovnrianao  matrix  cannot  have  rank 
greater  than  tho  number  of  entities.  The  problem  of  how  the  concept  of  tho 
general  inverse  of  the  matrix  could  be  uoed  in  connection  with  the  image  analy¬ 
sis  type  of  factor  analytic  models  haa  not  yet  been  explored.  Whether  or  not 
this  would  be  a  fruitful  approach,  even  if  it  were  mathematically  and  com¬ 
putationally  feasible,  requires  further  investigation, 

l6.1.'j  Sasic  Structure  Solutions.  It  is  quite  possible  to  apply  any 
of  the  factor  analytic  procedures  we  have  discussed  in  previous  chapters  to 
the  types  of  transformed  covariance  or  correlation  matrices  which  we  work 
with  in  the  image  analysis  models.  Even  the  centroid,  the  group  centroid, 
and  the  multiple  group  methods  can  be  applied.  However,  after  going  to  all 
tho  trouble  of  calculating  the  inverse  of  the  matrix,  and  considering  the  ad¬ 
vantages  of  the  basic  structure  solution,  one  would  in  general  adopt  some 
basic  structure  type  of  solution,  particularly  when  high  speed  computers 
ai*a  available.  The  methods  basod  on  the  linage  analysis  approach  would  not  be 
feasible  for  aitable  sets  of  data  matrices  if  only  desk  computers  were  avail¬ 
able,  As  a  matter  of  fact,  it  is  only  for  small  demonstrations  or  fictitious 


•xamplos  that  one  would  be  likely  to  use  Uoik  ocmputers  for  the  types  of 
nodol#  outlined  below, 

16.2  Kinds  of  Mathoda 

As  lndloatad  above,  all  of  tha  mathoda  atart  with  a  oovarianoa  matrix 
which  conslata  of  tha  variance#  and  aovarianoaa  of  tha  laaat  square  oatlmatad 
variables.  We  assume  that  tha  data  matrix  has  been  raduood  to  standard  or 
normalised  form.  This  has  bean  dona  before  the  aymbolla  transformation  to 
tha  eatlmatod  or  Image  variables  has  bean  accomplished. 

On  tha  basis  of  tills  assumption,  we  then  have  four  different  variations 
of  the  factoring  procedure.  First,  tha  estimated  covariance  matrix  may  be 
factored.  Second,  the  correlation  matrix  of  the  estimated  variables  may  be 
factored.  Third,  the  covariance  matrix  of  estimated  variables  may  be  scalod 
in  such  a  way  that  it  la  independent  of  the  scaling  of  the  original  variables. 
Finally,  tha  inverse  of  the  covariance  matrix  may  be  scaled  so  that  it  yields 
the  best  least  aquare  approximation  to  the  identity  matrix, 

16.2.1  The  Estimated  Covariance  Matrix,  As  indicated  above,  the  matrix 
of  variances  and  covariances  of  the  variables  estimated  by  least  square  re¬ 
gression  from  the  duta  matrix  of  normalized  variables  can  be  obtained  by  suit¬ 
able  mathematical  transformation  of  the  correlation  matrix.  After  this  trans¬ 
formation  has  been  applied  to  the  correlation  matrix,  the  resulting  covariance 
matrix  is  subjected  to  a  basic  structure  type  solution  such  as  an  eigenvalue - 
eigenvector  solution  in  which  the  largest  roots  and  corresponding  vectors  are 
extracted  without  further  alteration  of  this  covariance  matrix. 

16.2.2  The  Estimated  Correlation  Matrix.  Instead  of  working  with  the 
covariance  matrix  of  estimated  variables,  one  may  wish  to  work  with  the  actual 
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correlation  matrix  of  these  estimated  variables.  Tills  is  a  simple  matter,  for 
one  oan  moroiy  pre-  and  poatmultiply  the  estimated  covariance  matrix  by  the 
reciprocal  square  root  of  its  diagonal,  or  what  amounts  to  the  sume  thing, 
by  the  reciprocal  square  root  of  the  variances  of  the  estimated  variables. 

This  correlation  matrix  with  unity  in  the  diagonal  is  now  faatored  in  the  con¬ 
ventional  manner  by  basic  structure  or  eigenvalue  procedures. 

16.2*3  The  Independent  Scale  Procedure.  It  will  be  recognized  that 
both  of  the  variations  considered  above  are  arbitrary  from  the  soaling  point 
of  view.  One  may,  however,  prefer  a  model  which  does  not  depend  on  the  as¬ 
sumption  of  either  a  standardized  data  or  an  image  matrix,  but  a  method  which 
is  independent  of  the  scaling  of  the  original  or  image  variables.  In  other 
words,  one  may  wish  to  use  a  procedure  so  that,  for  any  scaling  diagonal  one 
□ay  uaa  on  the  data  matrix,  this  diagonal  cancels  out  in  the  covariance  matrix 
which  io  finally  adopted  for  factoring.  The  third  method  achieves  this  objec¬ 
tive. 

16.2.4  The  Optimal  Residual  Matrix.  In  the  image  analysis  approach, 
each  vector  of  the  image  matrix  is  defined  as  the  part  of  each  variable  which 
can  bo  predicted  frcra  all  of  the  others.  Implicit  also  is  the  concept  of  the 
anti-image  matrix  which  consists  of  that  part  of  each  variable  which  cannot 
be  predicted  frcra  any  of  the  others.  We  may  therefore  also  define  an  anti- 
imago  covariance  matrix  as  indicated  in  Section  I6.7.  This  method  proceeds 
on  the  assumption  that  the  image  covariance  matrix  should  be  scaled  in  such 
a  way  that  when  the  anti-image  covariance  matrix  is  scaled  in  the  same  way, 
it  will  be  a3  close  to  an  identity  matrix  as  possible.  In  other  words,  the 
rationale  is  that  the  anti -image  covariance  matrix  shall  have  a  scaling  such 
that,  canpared  to  the  variances,  the  covariances  will  be  as  small  as  possible 
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In  the  least  square  sense. 

1 6*3  The  Image  Co variance  Matrix 

16,5.1  Characteristics  of  the  Method.  In  thla  method!  as  indicated 
above,  the  analyst a  ia  performed  directly  on  the  oovurlonee  matrix  of  the 
varlablea  vhleh  have  been  estimated  from  the  normalized  data  matrix  by  the 
least  square  model*  Zt  eon  be  aeen  from  the  mathematical  proof  of  this  method 
In  Goatlon  16.7  that  the  diagonal  or  variances  of  this  covariance  matrix  con¬ 
stat  of  the  dqu&red  multiple  correlations  of  eaoh  variable  with  all  of  the 
others. 

In  general,  any  method  of  factor  analysis  based  on  boeie  structure  pro¬ 
cedures  or  approximations  to  them  tend  to  give  the  greatest  weight  to  the 
variables  with  Idle  largest  variances.  Shat  is,  if  a  covariance  rather  than 
a  correlation  matrix  la  operated  upon,  other  thing*  being  equal,  tho  variablos 
with  the  largoot  variances  have  the  greatest  weight  or  influonoe  in  determin¬ 
ing  the  faator  loadings  for  that  matrix*  Zt  can  be  seen,  therefore,  that 
since  the  variances  are  equarod  multiple  correlation  coefficients,  those  vari¬ 
ables  which  have  the  highest  multiple  correlation  with  all  of  the  other  vari¬ 
ables  receive  the  greatest  wight  In  the  determination  of  the  basic  structure 
faotor  matrix.  Conversely,  variables  with  very  low  multiple  correlations  re¬ 
ceive  very  little  weight  in  the  solution.  In  particular.  If  a  variable  ia  en¬ 
tirely  independent  of  the  others— that  is,  if  it  has  zero  correlations— it  re¬ 
ceives  no  weight  whatever,  and  will  therefore  not  have  a  loading  in  any  of  the 
factors. 

The  rationale  here  can  obviously  be  defended  if  one  takes  the  position 
that  he  is  interested  only  in  the  factor  loadings  for  those  factors  which  are 
con-man  to  two  or  more  of  the  variables.  This  is  the  traditional  Thurstoniun 
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approach  to  the  problow,  Tho  ccminallty  concept  appear*  to  make  more  sense 
fron  tho  mathematical  and  theoretical  point  of  view  via  tho  imago  analyeis 
approach  than  via  tho  more  traditional  approach  In  whioh  one  altoro  tho  di¬ 
agonal  o'iemonto  without  altering  the  correlation  coofficlonto.  It  would  ooem 
that  any  dofonoible  approach  ohould  bo  baood  on  oano  tranoformation  of  tho  data 
matrix,  rather  than  on  the  data  matrix  pluo  oanething  which  it  not  connected 

in  any  way  with  tho  data  matrix.  Thi*  latter  is  implicit  in  tho  conventional 
communal! ty  approach, 

16,3.2  Computational  Equations 
16.3.2a  Definition  of  notation 

R  in  tho  correlation  matrix. 

Rl  is  tho  invoroe  of  R. 


(16.3.1) 

(16.3.2) 

(16.3.3) 
(I6.3.IO 


Dp  ia  the  diagonal  of  g» 

W  estimated  covariance  matrix, 

a  is  the  factor  loading  matrix. 

16,3.2b  The  Equations 

p-  R* 

D-D* 

P 

GP  -  p  -  Dp 

fP  " 


CR  -  R  -  D  (16.3.3) 

Cy  M  "  CR  +  (16.3.6) 

Cy  y  ■  Q  8  V  (16.3.7) 

a  -  QB*  (16.3.8) 


16.3*3  Computational  Instructions,  Wo  assume  that  the  matrix  of  cor- 
relations  of  the  variables  to  be  factored  is  available.  This  matrix  ve  in¬ 
dicate  by  R.  The  first  step  is  to  calculate  its  inverse  by  one  of  the  con¬ 
ventional  procedures*  Bq.  (16,3. 1)  indicates  the  inverse  of  the  correlation 
matrix.  Wc  designate  this  by  £. 

Eq.  (16,3.2)  is  the  diagonal  matrix  whose  elements  are  the  reciprocals 
of  the  diagonal  elements  In  the  matrix  given  by  Bq.  (16.3.1). 

DO  next  indicate  the  inverse  of  the  correlation  matrix  with  the  diagonal 
elements  removod  or  made  0,  as  in  Bq.  (l6.3>3)» 

•The  next  stop  is  the  pro-  and  postmultiplication  of  the  matrix  given  by 
Eq.  (l6.3.3),  by  the  diagonal  mutrix  of  Eq.  (16,3.2).  Thia  is  indicated  by 
Eq.  (16.3.10. 

The  next  otep  consists  of  subtracting  frera  the  original  correlation 
matrix  the  diagonal  matrix  of  Eq.  (l6.3»2).  This  is  indicated  in  Eq.  (16.3.5)* 
It  can  be  shown  that  the  diagonal  elements  in  the  matrix  on  the  left  hand  side 
of  Eq.  (16.3,5)  are  now  the  squared  multiple  correlation  coefficients  of  each 
variable  with  the  remaining  variables. 

Wo  next  add  together  the  matrices  given  by  Eqs.  (l6»3»*0  and  (l6,3.5), 
as  Indicated  in  Eq,  (16.3.6),  This  is  now  the  covariance  matrix  of  the  esti¬ 
mated  variables,  or  the  image  covariance  matrix. 
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Eq»  (15,3,7)  indicates  tha  basic  structure  solution  of  this  imago  co¬ 
variance  matrix. 

The  analysis  may  b«  carried  to  as  many  factors  as  desired.  There  seems 
to  be  no  very  good  rule  for  thla  particular  model,  but  a  rough  rule-of-thumb 
criterion  is  that  the  aunt  of  the  currently  calculated  basia  diagonals  be  ap¬ 
proximately  CO  to  83  percent  of  the  trace  of  the  image  covariance  matrix 
given  by  Eq,  (16.3,6), 

Eq.  (16,3,8)  gives  the  factor  loading  matrix  as  a  funatlon  of  the  basic 
diagonal  and  the  basic  orthonormal  vectors  indicated  in  Eq,  (16.3,7). 

16.3,4  Numerical  Example,  The  correlation  matrix  used  hare  is  the 
same  bo  in  previous  chapters, 

Table  16,3,1  gives  the  image  covariance  matrix  of  the  correlation  matrix 
The  inverse  of  the  correlation  matrix  is  not  displayed,  although  it  oan  be 
printad  out  from  the  appropriate  Fortran  program  if  desired.  The  procedure 
for  calculating  the  Inverse  is  given  in  Chapter  3,  Section  3*3*  This  is  in¬ 
cluded  as  "Subroutine  Symin"  in  the  Fortran  listing. 

Tito  first  row  of  Table  16*3.2  gives  all  the  basic  diagonal  elements  of 
the  image  covariance  matrix.  The  body  of  the  table  gives  the  column  vectors 
of  the  left  basic  erthonormal.  These  are,  of  course,  proportional  to  tho  cor 
responding  factor  loading  vectors  of  the  image  covariance  matrix.  The  basic 
orthonormal  matrix  must  be  postraultiplied  by  the  square  root  of  the  basic  di¬ 
agonal  matrix  to  yield  the  principal  axis  vectors.  These  have  not  been  colcu 
latod.  The  basic  structure  factors  are  probably  of  more  interest  than  the 
principal  axis  vectors,  although  the  latter  could  readily  be  obtained  by 
several  additional  statements  in  the  Fortran  program. 
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Table  16,3, 1  ■  Imago  Covariance  Matrix 

0.7531  0,6080  0,6621  0,1204  0,0652  0,1011  0,2936  0.3018  0,3356 

0.6000  0.7444  0,6659  0,1472  0.0672  0,1167  0,3163  O.3067  0,3577 

0.6621  0,6659  0,6905  0.2146  0,1693  0,2309  0.2077  0,3047  0.3554 

0,1204  0,1472  0,2146  0,5114  0,4075  0,4942  0,2182  0.1784  0.2893 

0.0652  0.0672  0.1693  O.4075  0,5720  0,4858  0.1611  O.C$l4  0,2464 

0,1011  O.U67  0.2389  0.4942  0.4058  0,5624  0.1602  0.1417  0.2625 

0.2936  0.3163  0,2077  0.2182  0,1611  0,1602  0,4808  0,3964  0.4177 

0.3018  0.3067  0,3047  0.1784  0,0014  0.1417  0,3964  0.4989  0,3805 

0.3356  0.3577  0,3554  0.2853  0.2464  0,0625  0.4177  0.3685  0,4359 


Tabla  16,3.2  -  Basic  Diagonal  and  Basic  Orthonorrwl  of  Image  Covariance  Matrix 

3.0137  1.3337  0,5792  0.1254  0.0651  0.0508  0.0371  0.0214  0.0029 

-0.4108  0.3458  -0.2489  0.0005  -0.4535  0.0380  0.6019  0.2427  -0.1224 

-0.4221  O.3318  -0,2246  0.1425  0.4852  -0.4261  -0.3195  0.1327  -0.3261 

-0.4310  0.2016  -0.3089  -0,2148  -0.0538  0.3573  -0.2874  -0.4966  0.4149 

-O.2507  -0.4596  -0.0780  -0.0329  0.1784  -0.5532  0.3800  -0.1702  0.4442 

-0.2172  -0.5232  -0.1902  0.4109  -0.5056  -0.0719  -0.3eo4  -0.0709  -0,2522 

-0.2472  -0.4862  -O.1926  .0.4374  0.3164  0.4173  0.1472  0.1934  -0.3752 

-0.3027  -0.0133  0.5306  0,4669  0.2479  0.2779  0.2532  -0.4101  -0.1940 

-0.2924  0.0468  0.5653  -O.5696  -0.3283  -0.2947  -0.1488  -0.0951  -0.2063 

-0.3391  -0.0765  0.3343  0.1533  0.0352  0.1999  -0.2234  0.6544  0.4739 
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16,4  The  Imago  Correlation  Matrix 

16.4.1  Characteristics  of  tho  Method,  Tho  method  is  similar  to  most 
of  tho  conventional  msthods  of  faotor  analysis  wo  have  considered  in  previous 
chapters  in  that  we  begin  with  the  matrix  of  the  correlations  of  measures 
with  unity  in  the  diagonal.  Here  we  make  an  arbitrary  assumption  that,  for 
the  particular  sample,  eaah  of  the  estimated  variables  should  have  equal 
variance.  The  rationale  or  justification  for  this  assumption  is  probably 

no  versa  or  better  than  such  an  assunptlon  for  the  original  data  matrix.  If, 
however,  one  assumes  that  variables  which  correlate  low  with  others  should 
not,  therefore,  be  weighted  leas  in  the  faotor  solution,  the  procedure  of 
using  unit  variances  for  the  image  variables  is  justified.  In  any  cade, 
this  method  does  give  relatively  more  weight  to  the  variables  which  have  the 
greater  unique  variance  than  does  the  previous  method. 

16.4.2  Computational  Equations 

16.4.2a  Definition  of  Notation 

Cy  y  is  the  estimated  covariance  matrix. 

Dg-i  is  the  diagonal  of  R1 . 

Ry  ia  the  estimated  correlation  matrix. 

Q  B  Q1  is  the  basic  structure  of  Ry  y. 

16.4.2b  The  Equations 

Given  the  Cy  y  matrix 

d  -  (I  - 


(16.4.1) 
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•  <»’1  %  w  **  (.16*4*2) 

J\n,  -  Q  »  Ci*  -  «  (16.4.3) 

a  -  Q  6^  (16.4.4) 

16.4.3  Computational  Znatruotlons.  Ths  computational  Instruatlon*  for 
this  procedure  involve  only  a  fow  nor*  stapi  than  thosa  of  tha  previous  method. 
We  begin  In  tha  some  way  by  calculating  the  covariance  matrix  of  the  Image 
valuables,  that  la,  the  Cl.  w  matrix*  We  have  seen  that  the  diagonal  olements 
of  this  covariance  matrix  are  given  by  the  identity  less  a  diagonal  matrix 
which  is  tha  Inverse  of  the  diagonal  elements  of  the  Inverse  of  the  correla¬ 
tion  matrix.  This  la  indicated  In  Eq.  (16.4.1).  It  Is  precisely  a  diagonal 
matrix  of  the  squared  multiple  correlation  coefficients  of  each  variable  with 
all  the  remaining  variables. 

The  next  sot  of  computational  steps  Is  given  In  &i.  (16.4.2).  This  con¬ 
sists  of  pro-  and  postmulti plying  the  covorianco  Image  matrix  by  the  inverse 
of  tha  d  matrix  calculated  in  Eq.  (l6.4,l).  The  resulting  matrix  Is  the  cor¬ 
relation  matrix  of  the  imago  variables. 

The  next  set  of  computations  consists  in  finding  the  basic  structure 
factor  vectors  for  the  required  number  of  factors,  as  indicated  In  Eq. 

(16.4.3) . 

Tha  factor  loading  matrix  Is  indicated  in  the  conventional  manner  in  Eq. 

(16.4.4) . 

16.4.4  numerical  Example.  We  use  the  some  correlation  matrix  as  in  tha 
previous  section.  Here  we  bogln  vith  the  image  covariance  matrix  solved  for 
In  the  previous  section, 


Tab  is  16.4,1  give*  the  correlation  matrix  obtained  from  tho  imago  ao. 
varlanoo  matrix,  This  i>  obtained  by  pro>  and  postmulti plying  tho  imago  oo« 
variance  matrix  by  the' reciprocal  square  root  of  Ita  diagonal, 

Tho  flrat  row  of  Table  16,4,2  glvoa  tho  elementa  of  tho  basic  diagonal 
of  the  Imago  correlation  matrix,  Tho  body  of  tho  table  glvoa  tho  loft  baaia 
orthonormal  of  thla  matrix.  It  may  bo  tranaformed  to  a  factor  loading  matrix 
by  the  usual  method  indleatod  In  Eq,  (16,4,4), 

16,5  Tho  Zndopondont  Joalo  Matrix 

16.5.1  Charactoriatlos  of  tho  Method,  Tho  previous  two  methods  which 
wo  considered  wore  based  on  arbitrary  scaling  procedures.  In  tho  first  case 
wo  required  that  tho  original  variables  bo  in  standard  acoro  form,  and  In  the 
second  case  we  required  that  tho  image  variables  bo  in  standard  score  form. 

It  may  be  desirable  to  have  a  method  which  does  not  Impose  any  such  arbit¬ 
rary  scaling. 

We  therefore  consider  a  method  which  scales  the  image  covariance  matrix 
in  such  a  way  aa  to  cancel  out  any  particular  scaling  which  has  been  applied 
to  the  original  or  image  variables. 

This  method  also  has  some  interesting  characteristics  which  are  indicated 
in  Section  16.7-3.  The  particular  scaling  applied  to  the  data  matrix  ia  such 
that  the  image  covariance  matrix  ia  the  sum  of  the  covariance  matrix  of  the 
scaled  data  matrix  and  the  inverse  of  this  covariance  matrix,  lees  twice 
the  identity  matrix. 

16.5.2  Computational  Equations 

16,5,2a  Definition  of  Notation 


Tabla  16,4,1  -  Image  Correlation  Matrix 

1,0000  0,9314  0,9306  0,1966  0,1008  0,1374  0,4946  0,4990  0.5936 

0.9314  1,0000  0,9209  0,2367  0.1029  0.1003  0.5207  0.5033  0.6279 

0,9306  0,9209  1.0000  0,3612  0.2695  0.3034  0.4992  0.5192  0.6479 

0,1966  0,2367  0,3612  1,0000  0.9015  0.9214  0.4400  0.3532  0.6o42 

0,1008  0.1029  0,2695  0.9013  1,0000  0.0566  0.3072  0.1524  0.4934 

0.1574  0,1003  0.3034  0.9214  0.0566  1,0000  O.308I  0.2674  0,5301 

0.4946  0.5207  0.4992  0.4400  0.3072  0.3001  1.0000  0.0093  0,9125 

0.4990  0.5033  0,5192  0.3532  0.1524  0.2674  0.0093  1.0000  0.0330 

0,5936  0,6279  0.6479  0.6042  0.4934  0.5301  O.9125  0.0330  1.0000 


Table  16,4,2  -  Basic  Diagonal  and  Baals  Orthonormal  Matrix  of  Image  Correla¬ 
tion  Matrix 

5.1559  2.2350  1.0679  0.2392  0.1099  0.0003  0.0509  0.0397  0.0052 

-0.3300  -0.3557  -0.3292  -0.0630  -0.3110  0.0426  -0.6000  -0.4021  -0.1445 

-0.3392  -0.3420  -0.3060  -0,1105  0.2553  -0.4410  0.5042  -0.0200  -0.3007 

-0.3660  -0.2347  -0.3792  0.1657  0.0109  0.3361  0.0650  0.5459  0.4720 

-0.3094  0.4512  -0.0757  0.0509  0.0797  -0.6697  -0.2413  -0.0117  0.4223 

-0.2523  0.5030  -0.1594  -0.3643  -0.6019  0.1279  0.22>»4  0.1799  -0.2512 

-0.2014  0.4640  -0.1700  0.3935  0.4700  0.3568  -0.1045  -0.1302  -0.3760 

-0.3535  -0.0798  0.4927  -0.4978  O.3103  0.0554  -0.3357  0.3636  -0.1699 

-0.3312  -0.1450  0.5081  0.6234  -0.3792  -0.1391  0.0655  0.1355  -0.1914 

-0.4104  -0.0036  0.2999  -0.1644  0.0419  0.2760  0.3666  -0.5830  0.4030 


Cw  w  la  the  estimated  covariance  matrix* 

0  la  tha  estimated  covurianoe  matrix  Independent  of  scale, 
Q  ft  Q'  la  tha  baalo  atruotura  of  G. 


l6*5.2b  Tha  Equations 
Given  tha  CM  w  matrix 

d  -  D*-i 

0  -  dcwwd 

0  -  Q  ft  Q' 

a  -  Qft* 


(16.5.1) 

(16.5.2) 

(16.5.3) 

(16.5.4) 


16.5.5  Computational  Instructiona.  This  method.  Ilka  the  previous  one, 
begins  with  tha  covariance  matrix  of  the  image  variables.  It  may  or  may  not 
be  baaed  on  an  image  covariance  matrix  derived  fran  standard  measures.  The 
result  la  the  same  whether  it  is  applied  to  a  matrix  derived  from  standard 
ioea3ures  or  to  a  matrix  derived  from  arbitrarily  scaled  measures.  For  con¬ 
venience  we  shall  assume  that  the  image  covariance  matrix  is  based  on  stand¬ 
ardized  measures. 

Me  begin  with  a  diagonal  matrix,  as  indicated  in  Eq.  (16.5.1).  This  is 
a  diagonal  matrix  made  up  of  the  square  roots  of  the  diagonal  elements  in  the 
Inverse  of  the  correlation  matrix. 

We  now  pre-  and  postraultiply  the  covariance  matrix  of  the  image  vari¬ 
ables  by  this  diagonal  matrix,  as  indicated  in  Eq.  (16.5.2).  This  we  call 
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ths  0  matrix*  This  matrix  now  has  tha  intaraatlng  proparty  that  it  la  tha 
aum  of  a  matrix  and  Ita  Invars®  laaa  twice  tha  ldantlty  matrix. 

Kq.  (16,5,5)  lndloataa  tha  basic  atruoturo  resolution  of  tha  £  matrix* 

Eq,  (16*5*4)  glvaa  the  principal  axla  factor  loading  veotora  far  tha 
apaclflad  nambar  af  faotora. 

16,5*4  Kumarloal  Example,  We  use  tha  correlation  matrix  aa  In  tha  pre¬ 
vious  aaotlona  and  bagin  with  the  Image  covariance  matrix  aa  oaloulated  in 
thoaa  examples , 

Tha  first  row  in  Table  16.5,1  gives  tha  baalo  diagonal  elemanta  of  tha 
ao ale -free  image  oovarianoa  matrix.  Tha  body  of  tha  table  glvaa  tha  left 
basic  orthonormal  of  this  matrix.  Perhaps  tha  moot  striking  feature  of  thia 
table,  aa  compared  with  corresponding  tables  for  the  two  preceding  methods, 
ia  tha  large  first  eigenvalue  of  6.9569. 

16.6  The  Optimal  Residual  or  Anti -Image  Matrix 

16.6.1  Characteristics  of  the  Method.  This  method  la  somewhat  differ¬ 
ent  In  rationale  from  the  previous  methods.  It  begins,  as  they  do,  with  a 
covariance  matrix  of  the  image  variables,  but  the  rationale  for  the  scaling 
procedure  la  less  arbitrary  than  In  the  first  two,  although  perhaps  in  a 
aenae  more  arbitrary  than  for  the  third  method. 

Here  the  essential  consideration  la  one  developed  independently  by 
Quttraan  (1956)  and  Harris  (1962).  They  were  concerned  with  a  scaling  ration¬ 
ale  for  which  the  scaled  anti -image  covariance  matrix  yields  the  best  least 
square  approximation  to  an  identity  matrix,  The  method  is  of  particular 
interest  because  of  the  recent  work  of  Harris  (1962)  in  which  he  has  been 
concerned  with  the  estimation  of  diagonal  elements  in  the  correlation  matrix 
which  will  yield  the  best  approximation  to  a  lower  rank  approximation,  Thia 
is  the  conventional  c"mmunality  problem. 
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Table  16,5.1  -  Baaio  Diagonal  and  Basic  Orthononsal  of  Scale-Free 
Image  Matrix 

0.95 CO  3.295O  I.23O3  0.2707  0.2056  0.1196  0.1001  0.0466  0.0066 

-0,5144  O.2675  -O.162Q  -0,0754  0.6286  0.1830  -0.4206  0.1335  -O.0905 

-0,5353  0,2510  -0.1301  -0.2229  -0.6625  0,2269  0.1128  0.1484  -0.2414 

-0.4003  0.0791  -0.2376  0.3257  0.0569  -0.4390  0.3673  -0.3991  0.3322 

-0.1609  -0.4706  -0,0663  -0.0277  -0.1704  0.4936  -0.3349  -0.3726  0.4650 

-0.1329  -0,5571  -0.2088  -0.4379  0.3024  0.0869  0.5231  0.0373  -0.2501 

-0.1608  -0,5268  -0.1949  0.4610  -0.1566  -0.3049  -0.3482  0.2665  -O.3692 

-0,2160  -0.1096  0.5587  -0.4044  -0.0401  -0.4185  ”0.2722  -0.4061  -0.2233 

-0.2166  -0.0592  0.6101  0.5023  0.1264  0.4003  0.3018  -0.0429  -0.2225 

-0.2348  -0.1624  0.3601  -0.1329  -0.0104  -O.1904  0.0567  0.6503  0.5556 
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16, C, 2  Computational  Equation* 
16,6,2%  Definition  of  Notation 


®y  y  the  estimated  covariance  matrix* 

(2) 

C-LL  i#  a  matrix  whose  elements  ara  tha  squares  of  tba  alamanta 
in  £. 


L  1»  tha  eovarianoe  matrix  with  optimal  residual  vorianoa 
anta. 

16.6.2b  Tha  Equations 
P  -  Hf4 

p  .  r<2> 

dl  -  P*  1 
P 

D  *  d^  0 
P 

7  "  D^VfD 
7  »  Q  8  Q' 

a  »  Q  6^ 


ompon- 


(16.6.1) 

(16.6.2) 

(16.60) 

(16.6.4) 

(16.6.5) 

(16.6.6) 
(I6.6.7) 


16,6,3  Computational  Instructions,  The  computations  begin  with  the 
Image  covariance  matrix  calculated  as  in  the  previous  methods.  However,  we 
must  go  back  now  to  a  aolution  of  the  scaling  diagonal.  We  begin  with  the 
inverse  of  the  correlation  matrix,  as  indicated  in  Eq.  (l6.6,l). 
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Next  ve  square  each  of  the  element*  of  ths  Invar**  unluulatsct  in  Eq, 

(16.6.1) ,  m  indieatsd  In  Eq,  (16,6,2),  Tha  superscript  2  enclosed  in  pnron- 
thesee  means  that  saeh  clamant  of  tha  matrix  on  tha  right  hand  alda  nf  tha 
aquation  ha*  baan  aquarad. 

Next  vo  oaloulata  a  vector,  aa  indioatad  in  Eq,  (l 6,6,)),  Tha  right 
hand  aide  of  thia  aquation  ohova  that  tha  vaotor  consists  nf  tha  diagonal 
elements  of  tha  invara*  of  tha  correlation  matrix  given  by  Eq,  (16,6,1).  Wo 
then  premultiply  thia  vaotor  by  the  invara*  of  tha  matrix  calculated  in  Eq. 

(16.6.2) . 

W*  now  define  a  new  diagonal  matrix,  a*  in  Eq,  (1 6.6,4).  This  matrix 
la  obtained  by  taking  the  diagonal  element*  of  tha  inveroe  of  the  correlation 
matrix  and  multiplying  theae  by  the  aquare  roots  of  the  elements  calculated 
In  Eq.  (16,6.3).  It  should  be  observed  that  the  solution  given  by  Eq.  (16.6.3) 
does  not  indicate  offhand  that  all  elements  in  tha  d  matrix  must  be  positive. 
If  they  are  not  positive,  of  course,  ve  cannot  have  real  numbers  for  their 
square  roots.  This  is  a  limitation  of  the  method.  Research  to  date  seems 
to  indicate  that  with  most  experimental  data  matrices,  Eq,  (16.6.3)  will  give 
all  positive  elements. 

We  next  pre-  and  postmultiply  the  image  covariance  matrix  by  the  diagon¬ 
al  matrix  of  Eq,  (l 6,6.4)  to  get  a  7  matrix,  as  in  Eq,  (16.6.5).  This  ia  the 
matrix  which  we  now  factor. 

The  basic  structure  of  this  matrix  is  indicated  in  Eq,  (16.6.6). 

The  factor  loading  matrix  is  given  in  Eq.  ( 16.6.7),  This  is  simply  the 
usual  principal  axis  factory  -uleulated  for  the  desired  number  of  factors, 

16.6.1*  Numerical  Example.  We  use  the  correlation  matrix  as  in  the  pre¬ 


vious  section 
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Tnbln  16,6,1  gives  the  invars*  of  the  correlation  matrix* 

Tito  body  of  Table  16,6,2  la  the  inverse  of  the  matrix  obtained  by  squar¬ 
ing  the  elements  of  Table  id, 6,1,  The  row  at  the  bottom  of  the  table  contains 
the  elements  of  the  scaling  diagonal, 

'  f 

The  body  of  Table  16,6,3  gives  the  image  covariance  matrix  scaled  so  that 
the  corresponding  anti -image  matrix  is  the  best  least  square  approximation  to 
the  identity  matrix. 

The  first  row  of  Table  16,6.4  consists  of  the  elements  of  the  basic  di¬ 
agonal  of  the  matrix  in  Table  16.6.3.  The  body  of  the  table  is  the  corres¬ 
ponding  left  basic  orthonormal. 

16,7  Mathematical  Proofs 

16.7,1  The  Estimated  Covariance  Matrix 

Olven  the  data  matrix  x  in  standard  measures.  We  consider  another  matrix 


W,  such  that  eaah  vector  W^  of  W  is  the  least  square  estimate  of  calcu¬ 


lated  from  thr  remaining  n-1  vectors  of  x.  Wo  let 


R 


x*  x 
N 


(16,7.1) 


We  let  £  be  the  matrix  of  regression  coefficients  for  estimating  each  variable 
frctn  the  remaining  n-1  variables  so  that 


W  m  x  3 


(16.7.2) 


It  is  well  known  that  |3  is  given  by 

P  -  I  -  R*  Djj-i  (16.7.2) 

if  the  variables  are  standard  measures  and  Dn-l  is  the  diagonal  of  R*1.  We 


140 


Tabio  16,6,1  -  Invors*  of  Correlation  Matrix  or  £ 

3.74 63  -2.0659  -1.2821  0.0950  0.'.-322  -0,0594  -0,0314  -0,0542  -0,1026 
-2.0659  3,9116  -1,3784  0.2562  0.0563  -0, 0-/44  -0,0506  -0,314?  -O.C r/07 
-1.2021  -1.3784  3.2313  -0.3794  -0.2692  O.OO60  -0.0519  0,2176  -0.1694 
0,0950  0,2582  -0,3794  2.0465  -O.7099  -0,6166  -0,1015  -0,0167  -O.3O30 
0.2822  0.0563  -0,2692  -0.7099  2.3365  -1.1916  0.1040  -0,0447  -0.0316 
-0.0594  -0.0744  0,0063  -0.6166  -1.1916  2.2853  -0,1310  0,1764  -0.1155 
-0.0314  -0.0506  -0.0519  -0,1215  0.1040  -0,1310  I.9261  -0,9902  -0.3751 
-0.0542  -0.3145  0.2176  -0.C1Q7  *0.0447  0.1764  -0.9902  1.9950  -0.5397 
-0.1026  -O.O707  -0.169J*  -O.303O  -0.0316  -0,1155  -0.3731  -0.3397  1,7726 


Table  16.6,2  -  Inverse  of  P  Matrix,  and  3callng  Diagonal*  for  Optimal 
Error  or  AnTi -Imago  Matrix 

0,0/86  -0.0209  -0.0086  0.0006  -0.0011  0.0002  -0.0002  0.0006  -0.0002 

-0.0209  0.0724  -0.0099  -0.0008  0.0005  -0.0001  0.0004  -0,0018  0.0002 

-0.0086  -0.0099  0.0990  -0.0031  -0.0010  0.0005  0.0002  -0,0009  -0.0007 

0.0006  -0.0008  -0.0031  0.2425  -0.0191  -0.0124  -0.0008  0.0009  -0.0071 

-0.0011  0.0005  -0.0010  -0.0191  0.1987  -0.0526  -0.0004  0.0004  0.0007 

0.0002  -0.0001  0.0005  -0.0124  -O.O526  0,206/  -0.0003  -0.C015  -0.0003 

-0.0002  0.0004  0.0002  -O.C008  .0,0004  -0,0003  0.2804  -0.0706  -0.0002 

0.0006  -0.0018  -0.0009  0.0009  0.0004  -0,0015  -0.0706  0.2701  -0.0219 

-0.0002  0.0002  -0.0007  -0.00/1  0.000?  -0.0003  -0.0062  -0.0219  0.3208 

1.6103  1.6127  1.5790  1.2936  1.2807  1.2964  1.2215  1.1905  1.2497 


I* 
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Table  1 6,6,)  •  Image  Covariance  Matrix  flcaled  for  Optimal  Anti -Image 
Matrix 

1.5000  1,7067  1.6034  O.2500  0.1346  0,2110  0,5770  0,5705  0.6752 

1.7067  1,9350  1.6957  0.3072  0,1307  0.2439  0.6230  0,5009  0,72o0 

1.6034  1.6957  1.J216  0.4384  0.3424  0,4091  0,5540  0,572 0  0.7013 

0.250 0  0.3072  0,4364  0.0558  0.0077  0,8207  0.3447  0.2748  0.4611 

0.1346  0,1307  0.3624  O.0O77  0.9382  0.C066  0,2320  0.1241  0.3943 

0.2110  0.2439  0.4091  O.0207  O.8066  0,9452  0.2530  0.21C6  0.4252 

0.5776  0.6230  0.5540  0.3447  0.2520  O.2530  0,7174  0.5764  0.6376 

0.5785  O.5OO9  O.5728  0.2740  0.1241  0.21C6  0.5764  0.7071  0.5779 

0.6752  O.72O0  0.7013  0.4611  0.3943  0.4252  0,6376  0.5779  0.6007 


Table  16,6.4  >  Basic  Diagonal  and  Orthonormal  for  Ucalod  Image  Covariance 
Matrix 

6.4745  2.4373  0.9357  0.2035  0.1430  0.0915  0.0730  O.O30O  0.0052 


-0.4973 

-0.5075 

-0.4937 

-0.1(304 

-0.1400 

-0.1720 

-0.2281 

-0.2181 

-0.2643 


-0.2864 

-0.2653 

-0.1097 

0.4946 

0.5336 

0.5154 

0.1037 

0.0494 

0.1655 


0.1653 

0.1303 

0.2564 

O.O033 

0.2088 

O.2O07 

-0.5631 

-0.5767 

-0.3822 


0.1004 

0.2162 

-0,3160 

0.0303 

0.4374 

•0.4509 

O.3697 

-0.5284 

0.1272 


0.6053 

-0.6671 

0.0677 

-0.1C85 

0.3220 

-0.1466 

-0.0515 

0.1431 

-0.0054 


-0.2447 

-O.2O04 

0,4550 

-0.5371 

-0.0198 

0.2876 

0.3504 

-O.303O 

0.2073 


0.4102 

•0.1616 

-0.2944 

0.2670 

-0.5343 

8  m 

-0.3355 

-0.0633 


0.1503 

0.1532 

-0.4056 

-0.3289 

0.0142 


-0.0583 

0.6497 


-0.0974 

-0.2651 

0.3395 

0.4594 

-0,2659 

-0.2346 

0.5210 


1»0 

From  Eqs.  (15.7.1),  (16.7.4),  and  (16,7.9) 

CM  w  -  (i  -  t£i  a4)  n  (1  •  R*  oji)  (16.7.14) 

or 

Cy  y  ■  R  -  2  dJi  +  D*-X  R‘X  dJi  (16.7.15) 

From  Eqa.  (16.7.I),  (16.7.4),  (15.7.6),  and  (16.7.IO) 

Cy  E  -  -  Egl  R*  DjH  (16.7.16) 

From  Eqa.  (16.7.1),  (16.7.6),  and  (16.7.11) 

CEE  "  DR’i“lDflH  (16.7.17) 

The  rolatlonahlps  among  the  various  covariance  matrices  are  obvious  and  have 
bean  discussed  by  Outturn  (1953)  and  Harris  (1962). 

One  may  now  regard  the  covariance  matrix  of  the  "estimated”  variables 
as  the  logical  matrix  to  factor,  since  presumably  it  has  removed  frcm  each 
variable  that  part  which  does  not  overlap  with  the  other  variables.  We  there¬ 
fore  let  the  basic  structure  of  Eq.  (16.7.15)  be 

Cy  ,j  -  Q»q'  (16.7.18) 

and  factor  to  the  desired  number  of  roots  and  vectors. 

16.7.2  The  Estimated  Correlation  Matrix 

Suppose  we  do  not  wish  to  factor  the  covariance  matrix  of  the  estimated 
variables,  but  rather  the  uatual  correlation  matrix  of  this  estimated  matrix. 
Wo  have  frcm  Section  16.7*1 


Vtk 

°ww  “  *  ■$* 

We  let 

d  -  D- 

“w  W 

Tho  matrix  wo  wish  to  factor  is 

*\j  W  “  CW  U 

Fra#  Eqa,  (16.7.19)  and  (16.7,20) 


(16.7.19) 


(16.7.20) 


(16.7.01) 


d  -  I  -  (16.7.22) 

It  1#  well  known  that  Eq,  (16.7.22)  ia  a  diagonal  of  tho  squared  multiplo  cor¬ 
relation#  between  each  variable  and  the  remaining  n-1  varlablea  of  the  aet. 

Wo  repoat  tho  covariance  matrix  of  the  eotimated  variable#  with  the  obaarved 
variabloa.  . 


Cx  W  "  R  “  DJ*  (16.7.25) 

It  ia  clear  from  Eqa,  (16.7.22)  and  (16.7.25)  that  the  diagonal#  of  w 

and  C  ,,  are  the  acme. 
x  W 

16.7,3  The  Solution  Independent  of  Scale 

Consider  again  the  covariance  matrix  of  the  estimated  variable#  x, 
namely, 

Cy  w  -  a  -  a  Djj-1  +  dJ*  r1  cg»i  (16.7.2)0 


It  may  be  doalrable  to  consider  a  factoring  of,  cay, 


0  -  dowwd 


(16.7.25) 


where  0  la  Independent  of  the  acaling  of  tho  variables.  That  ia,  we  remove 
tho  assumption  of  standardized  measures  In  x.  Suppose  we  let 

0  -  (16.7.26) 


where  now  we  plaee  no  reatrletions  on  the  scaling  of  x.  We  then  rewrite  Eq. 
(16.7.24)  us 


°»»  ■  0  -  t  dJ.  ♦  £1  C*  g. 


(16.7.27) 


Wo  lot 


C  ■  d  R  d 


(16.7.28) 


where  d  is  an  arbitrary  aculing  diagonal. 
Suppooo  we  let  D  in  I2q.  (16,7.25)  be 


D  . 


From  Eqo.  (16,7,24),  (16.7.25)  and  (16.7.29)  we  have 

°  •  4*  *  4*  - s  1  ♦  $  **  4 

Suppose  now  we  write  Eq,  (16.7.24)  in  the  fora  of  Eq.  (l6,7»30) 

0  »  ri-i  c  nt-i  -21  +  D-l  c4  pit 


lC  c 


’C*  v  uc 


(16.7.29) 


(16.7.30) 


(16.7.31) 


From  Eqs.  (16,7.20)  and  (l6,7«3l)  we  see  that  the  d  matrix  cancels  out,  and 
Eq.  (16,7.31)  becomes  precisely  Eq.  (l6.7.30)»  Therefore  a  in  Eq.  (16,7.31) 


m 

la  independent  of  scale  and  would  noon  to  bo  a,  desirable  matrix  for  to, etoring. 
yurthormoro,  suppooo  wo  lot 

e  •  4*“4‘  (W.7.M) 

Than  Eq.  (16.7.31)  can  bo  written 

0  •  «  ♦  «*  -  9  1  (16.7.M) 

Wo  also  know  that  the  bade  orthonormnle  of  g,  g*,  and  0  ore  the  same  and 
that,  If  tho  basia  otruoturo  of  g  is 


g  •*  Q  5  Q' 

then 

g4  ■  Q  ft’4  il' 
and 


(16.7.3*0 


(16.705) 


0  -  0  (ft  ♦  6*  -  2  I)  (16.7.36) 

It  uhould  alao  bo  noted  that  g1  is  tho  well  known  matrix  of  n-2  order  partial 
correlation  coefficients. 

lu . 7 * *»  The  Optiwul  Error  Covariance  Matrix 
Conaldar  again  tho  eatimatod  covariance  matrix 


°\i  w  m 

R  -  2  *  Dji  R-4  Djx 

(16.7.37) 

and  tho  eatimatod 

error  covariance  matrix 

CE  E  " 

(16.7.33) 

Vtf 

We  may  viuh  to  consider  a  uoallitfj  of  0^  w  in  Eq.  (16,7,37),  and  lienae  the 
some  sealing  of  Gg  In  Uq,  (l6,7,Jfl)#  whlah  will  result  In  the  boat  least 
square  appi’oxlmution  to  the  Identity  matrix,  We  may  then  equally  well  aon- 
sidor  the  sealing  of  U4  which  is  tlia  beat  least  square  estimate  of  the  iden- 
ti ty  matrix.  Let 

d  a4  d  -  I  »  «  (16.7.39) 

and  determine  d  ao  that 

tr  s's  u  min  » 

From  Eqo,  (l 6, (.39)  and  (l6«y.40) 

*  *  tr  (a  a4  a2  n4  d  -  2  d  »4  a  +  i) 

Let 

n4  -  p  (16.7.42) 

f 

and  from  Eqo.  (l6.7.4l)  and  (16.7.42) 

>•;  «  tr  (d  p  d2  p  d  -  2  d  p  d  +  1)  (16.7.43) 


(16.7.40) 


(16.7.M) 


Let 


V  ,  dl 


From  Eq.  (16.7.44) 

tr  (d  p  d)  »  V*  Dp  V 


(16.7.44) 


j 

] 


i 


1 


(16.7.45) 


m 

fiLi *  matrix  of  the  squared  elements  of  g,  Than  it  can  be  ahown 

that 

tr  (d  p  d2  p  d)  «  V'  4  p(2>  d  V  (16.7.1,6) 

Pi'orn  Eqo,  (16.7.43),  (16.7.44),  (16,7.43),  and  (16.7.46) 

*  -  V'  4  p<2>  (16.7.47) 

Differantiatina  Eq.  (16.7.47)  symbolically  with  I'eopoot  to  V* 


H  "  4  <d  P(a)  “  V  -  Dp  V) 
Equating  Eq.  (16.7.48)  to  zoro 

d  p^  d  V  ■  D  V 
P 

OP  from  Eqs.  (l6.7.44)  and  (16.7.49) 


(16.7.40) 


(16.7.49) 


(16.7.50) 


From  Eq.  (16.7.50) 

-n  -  (16.7.51) 

To  seals  Cw  w  in  Eq.  (16.7,37),  therefore,  so  that  tha  sealed  C-  .,  part  is 

'  U  Ci 

tho  boat  least  square  approximation  to  an  identity  matrix,  we  write  first 
from  Eq.  (16.7.37) 


V  °w  w  Dn1  "  V1  R  DR 1  “ 2  VA  +  R  * 


(16.7.52) 


